-- Logs begin at Thu 2022-08-25 23:51:57 UTC, end at Fri 2022-08-26 00:56:16 UTC. -- Aug 26 00:24:05.499431 dv-cinder-835384-25-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 26 00:24:05.508735 dv-cinder-835384-25-smb devstack@keystone.service[81529]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 26 00:24:05 2022] *** Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: nodename: dv-cinder-835384-25-smb Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: machine: x86_64 Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: clock source: unix Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: pcre jit disabled Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: detected number of CPU cores: 4 Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: current working directory: / Aug 26 00:24:05.511081 dv-cinder-835384-25-smb devstack@keystone.service[81529]: detected binary path: /usr/bin/uwsgi-core Aug 26 00:24:05.511618 dv-cinder-835384-25-smb devstack@keystone.service[81529]: your processes number limit is 47680 Aug 26 00:24:05.511618 dv-cinder-835384-25-smb devstack@keystone.service[81529]: your memory page size is 4096 bytes Aug 26 00:24:05.511618 dv-cinder-835384-25-smb devstack@keystone.service[81529]: detected max file descriptor number: 2048 Aug 26 00:24:05.511618 dv-cinder-835384-25-smb devstack@keystone.service[81529]: lock engine: pthread robust mutexes Aug 26 00:24:05.511618 dv-cinder-835384-25-smb devstack@keystone.service[81529]: thunder lock: enabled Aug 26 00:24:05.511618 dv-cinder-835384-25-smb devstack@keystone.service[81529]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 26 00:24:05.511618 dv-cinder-835384-25-smb devstack@keystone.service[81529]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 26 00:24:05.552028 dv-cinder-835384-25-smb devstack@keystone.service[81529]: Python main interpreter initialized at 0x55b8aadb09c0 Aug 26 00:24:05.552028 dv-cinder-835384-25-smb devstack@keystone.service[81529]: python threads support enabled Aug 26 00:24:05.552028 dv-cinder-835384-25-smb devstack@keystone.service[81529]: your server socket listen backlog is limited to 100 connections Aug 26 00:24:05.552028 dv-cinder-835384-25-smb devstack@keystone.service[81529]: your mercy for graceful operations on workers is 90 seconds Aug 26 00:24:05.552408 dv-cinder-835384-25-smb devstack@keystone.service[81529]: mapped 403077 bytes (393 KB) for 2 cores Aug 26 00:24:05.552488 dv-cinder-835384-25-smb devstack@keystone.service[81529]: *** Operational MODE: preforking *** Aug 26 00:24:05.552720 dv-cinder-835384-25-smb devstack@keystone.service[81529]: *** uWSGI is running in multiple interpreter mode *** Aug 26 00:24:05.552720 dv-cinder-835384-25-smb devstack@keystone.service[81529]: spawned uWSGI master process (pid: 81529) Aug 26 00:24:05.552925 dv-cinder-835384-25-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 26 00:24:05.554084 dv-cinder-835384-25-smb devstack@keystone.service[81529]: spawned uWSGI worker 1 (pid: 81539, cores: 1) Aug 26 00:24:05.554084 dv-cinder-835384-25-smb devstack@keystone.service[81529]: spawned uWSGI worker 2 (pid: 81540, cores: 1) Aug 26 00:24:05.554084 dv-cinder-835384-25-smb devstack@keystone.service[81529]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 26 00:24:09.861681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:24:09.861681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: from cryptography.utils import int_from_bytes Aug 26 00:24:09.862517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:24:09.862517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: from cryptography.utils import int_from_bytes Aug 26 00:24:09.864859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:24:09.864859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: from cryptography.utils import int_from_bytes Aug 26 00:24:09.865347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 26 00:24:09.865347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: from cryptography.utils import int_from_bytes Aug 26 00:24:09.912352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:24:09.912550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:24:09.912718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] command line args: [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:24:09.912989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:24:09.913176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ================================================================================ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:24:09.913425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] admin_token = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.913649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 26 00:24:09.913734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] config_dir = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.913827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.913918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 26 00:24:09.914040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] config_source = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.914184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] command line args: [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 26 00:24:09.914269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] debug = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.914344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 26 00:24:09.914422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.914669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ================================================================================ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 26 00:24:09.914746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] admin_token = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.914806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.914944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] config_dir = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] config_source = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] debug = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_config_append = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.915988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_dir = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_file = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.916907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_config_append = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_dir = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_file = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.917990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.918094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.918211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.918362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.918482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.918592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.918740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.918850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.919000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.919120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.919265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.919380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.919489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.919652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.919761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.919913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] publish_errors = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.920884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.921089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.921236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.921346 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.921462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.921462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.921700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.88/identity {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.921818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] standard_threads = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.921967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] publish_errors = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_journal = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_json = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_stderr = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.922945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.923015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] use_syslog = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.923185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] standard_threads = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.923283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.923449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.923543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.923666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.923745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.923846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.923931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.924031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_journal = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.924152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.924236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_json = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.924379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_stderr = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.924469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.924563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] use_syslog = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.924642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.924801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 26 00:24:09.924886 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.925053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.925144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.925298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.925385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.925553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.925631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.925797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.925907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.926642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.926787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.926943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.927961 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.928041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.928216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.928296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.928461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.928540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.928715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.928796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.928959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.929045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.929213 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.929293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.929450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.929524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.929693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.929771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.929948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.930975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.931145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.931223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.931374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.931469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.931603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.931687 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.932114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.932193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.932361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.932449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.932599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.932685 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.932847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.932925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.933078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.933169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.933315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.933393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.933552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.933629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.933783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.933869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934119 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.934987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.935995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.936144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.936221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.936377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.936454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.936619 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.936704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.936858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.936937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.937092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.937168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.937324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.937410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.937703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.937788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.937788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.937930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.938037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.938123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.938287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.938358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.938521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.938637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.938787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.938897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.939991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.940133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.940251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.940391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.940391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.940657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.940657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.940867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.940867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.941110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.941110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.941364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.941476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.941614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.942433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.942698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.942698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.943035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.943178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.943297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.943445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.943566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.943739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.943821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.943965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.944946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.945984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.946081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.946228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.946308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.946465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.946576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.946708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.946799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.946943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.947951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.948101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.948191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.948336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.948424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.948567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.948648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.948809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.948890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.949045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.949127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.949299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.949415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.949534 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.949660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.949788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.949921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.external = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950874 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.950990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.951118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.951266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.951393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.951523 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.951642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.password = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.951759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.951876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] auth.token = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.951992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.952118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.952245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.external = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.952364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.952482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.952598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.952719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.952836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.952966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.953092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.953092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.password = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.953312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.953312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.953530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] auth.token = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.953656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.953775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.953913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.954995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.955121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.955240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.955357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.955474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.955591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.955707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.955834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.955953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.956070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.956187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.956304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.956421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.956546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.956665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.956781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.956899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.957016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.957132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.957281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.957438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.957628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.957825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.958979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.959201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.959318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.959435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.959561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.959680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.959796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.959919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.960990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.961118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.961235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.961352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.961468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.961584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.961775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.961911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.962032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.962150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.962287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.962436 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.962571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.962758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.962878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.962996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.963113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.963230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.963359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.963477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.963593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.963716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.963834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.963950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.964075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.964195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.964311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.964434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.964552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.964669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.964794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.964913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.965029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.965146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.965264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.965380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.965504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.965623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.965738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.965855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.966974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.967093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.967209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.967326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.967442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.967558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.967683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.967801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.967918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.968974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.969100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.969217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.969333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.969451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.969567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.969697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.969817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.969950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.970068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.970185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.970312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.970439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.970565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.970683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.970846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.970978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.971096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.971222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.971340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.971457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.971576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.971693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.971809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.971934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.972052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.972169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.972285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.972401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.972524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.972656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.972775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.972917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.973078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.973275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.973476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.973641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.973762 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.974077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.974208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.974327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.974444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.974576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.974697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.974814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.974931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.975879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.976110 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.976227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.976343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.976467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.976586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.976711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.976831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.976948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.977064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.977181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.977298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.977423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.977541 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.977657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.977774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.977913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.978992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.979108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.979224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.979339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.979455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.979580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.979698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.979815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.979932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.980048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.980164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.980292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.980411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.980528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.980643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.980760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.980875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981119 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.981996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.982114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.982231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.982347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.982478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.982597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.982719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.982836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.982953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.983070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.983197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.983317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.983502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.983668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.983830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.983934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.984061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.984182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.984300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.984399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.984550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.984691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.984820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] role.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.984939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.985056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] role.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.985056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.985276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.985392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.985588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.985709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.985827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.985964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.986082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.986214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.986334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.986450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.986566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.986683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.986806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.986933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] role.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] role.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.987994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.988111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.988227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.988355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.989037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.989037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.989356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.989517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.989711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.989971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.990100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.990220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.990339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.990457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.990575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.990707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.990827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.990946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.991769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.992061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.992180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.992297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.992414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.992532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.992658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.992777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.992894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.993985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.994116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.994235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.994351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.994467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.994585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.994701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.994826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.994945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.995062 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.995178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.995294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.995411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.995536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.995656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.995772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.995889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.996958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.997076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.997193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.997309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.997426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.997552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.997679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.997812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.997975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.998095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.998212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.998329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.998446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.998576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.998696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.998814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.998930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.999048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.999164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.999290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.999409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.999526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.999642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.999759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:09.999877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.000953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.001072 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.001189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.001306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.001423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.001585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.001716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.001835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.001974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.002810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.003771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.003771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.003771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 26 00:24:10.003771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81540) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 26 00:24:10.030572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.030799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.031025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.033633 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.033894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.034130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.039555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.042678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.069690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.069940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.071349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.071588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.123628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.124284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.173276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.173504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.174504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.174745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.333351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.333577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.333676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.333799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.333935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.334047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.334135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.334268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.334354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.334484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.334570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.334703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.358887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.359114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.359291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.359403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.359531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.359616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.359749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.359831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.359965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.360050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.360180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.360263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.360397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.360616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.372070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.372638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.384986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.385172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.385364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.385464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.385607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.385689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.385826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.385933 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.386067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.386283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81539) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.386494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.386728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.386953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.387176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81540) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 26 00:24:10.403200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.403411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:24:10.403723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.403807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.403942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:24:10.404041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:24:10.404215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.404304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.404482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 26 00:24:10.404564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.404765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.404987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.405100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.405252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.405652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.405955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.415083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.415365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.415638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.415921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.416042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.416330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.416608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.416897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.422841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.423972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.425702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.426042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.426894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.427181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.427641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.427722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.427910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.427994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.428185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.428268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.428463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.428555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.428814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.428895 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.429087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.429170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.429371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.429453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.429656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.430076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.430365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.430646 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.452107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.453566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.453650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.453854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.455087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.455382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.458549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.458836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.459125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.460253 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.460545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.460836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.465418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.465704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.467198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.467513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.469768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.470079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.470368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.470654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.470935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.471214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.471490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.471669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.471753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.471968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.472261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.472553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.473368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.473661 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.473969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.474251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.490257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.490565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.492109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.492416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.494431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.496318 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.497629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.497951 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.499554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.499868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.502109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.504612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.505723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.507779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.508952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.509266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.509557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.509845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.510152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.510454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.511055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.511367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.511663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.511961 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.512254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.512561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.526454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.526763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.527044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.527310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.528810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.529106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.529393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.529673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.534136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.536197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.536479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.537647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.539121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.539212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.539410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.539497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.539721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.540016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.540294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.542218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.542513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.542823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.543116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.543402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.552296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.552602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.552889 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.553173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.553459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.553741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.554046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.555681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.555996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.556299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.556589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.557132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.557414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.557699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.569893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.572903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.573343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.575804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.576416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.577237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.578729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.579016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.579408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.579500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.580877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.582928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.583216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.583508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.586254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.587705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.590043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.590607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.590902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.591192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.591477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.591563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.594493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.594796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.595089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.595379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.599966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.600261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.600547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.603868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.604173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.604472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.607370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81539) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.607659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.607943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.608223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.608501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.608791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.609064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.609349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.609632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.609930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.610206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.610470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.610738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.611008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81539) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.611460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81540) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 26 00:24:10.611751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.612039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.612320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.612601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.612891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.613183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.613501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.613903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.614365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.614649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.614942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.615234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.615505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81540) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 26 00:24:10.645181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8aadb09c0 pid: 81539 (default app) Aug 26 00:24:10.648845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6bc33-07ae-4f2f-964b-467d12e09231 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:10.649134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6bc33-07ae-4f2f-964b-467d12e09231 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:10.649410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6bc33-07ae-4f2f-964b-467d12e09231 None None] PATH_INFO: `/v3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:10.650176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b8aadb09c0 pid: 81540 (default app) Aug 26 00:24:10.653567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1/1] 10.222.0.88 () {50 vars in 791 bytes} [Fri Aug 26 00:24:10 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:17.252619 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206ca2b-418e-45c1-b466-258cca72fbd4 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:17.253150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206ca2b-418e-45c1-b466-258cca72fbd4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:17.253150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6206ca2b-418e-45c1-b466-258cca72fbd4 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:17.257626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1/2] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:24:17.263090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:17.263488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:17.263638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:17.335186 dv-cinder-835384-25-smb devstack@keystone.service[81539]: INFO dbcounter [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] Registered counter for database keystone Aug 26 00:24:17.355413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG oslo_db.sqlalchemy.engines [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:24:17.362879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writer thread running {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:24:17.552291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG passlib.handlers.bcrypt [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81539) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 00:24:17.552621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG passlib.handlers.bcrypt [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81539) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 00:24:17.608235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:17.609871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:17.749320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 2/3] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:17 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 487 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 00:24:18.264618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206ca2b-418e-45c1-b466-258cca72fbd4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:18.335063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: INFO dbcounter [None req-6206ca2b-418e-45c1-b466-258cca72fbd4 None None] Registered counter for database keystone Aug 26 00:24:18.357906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG oslo_db.sqlalchemy.engines [None req-6206ca2b-418e-45c1-b466-258cca72fbd4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81540) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 26 00:24:18.364334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writer thread running {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 26 00:24:18.499808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6206ca2b-418e-45c1-b466-258cca72fbd4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:18.504667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d908b5-3150-4158-ae7c-7288953126c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:18.505467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d908b5-3150-4158-ae7c-7288953126c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:18.505747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d908b5-3150-4158-ae7c-7288953126c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:18.506048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d908b5-3150-4158-ae7c-7288953126c2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:18.514873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d908b5-3150-4158-ae7c-7288953126c2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:18.566047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING keystone.common.rbac_enforcer.enforcer [None req-19d908b5-3150-4158-ae7c-7288953126c2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 00:24:18.566900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d908b5-3150-4158-ae7c-7288953126c2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:18.577963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 2/4] 10.222.0.88 () {58 vars in 1324 bytes} [Fri Aug 26 00:24:18 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:24:18.584570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:18.601510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804989ca-a16b-489e-8f21-4579986d4d53 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:18.608209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2cda3-8eac-4dd1-bbeb-9e2f47de54e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:18.610077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2cda3-8eac-4dd1-bbeb-9e2f47de54e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:18.610574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2cda3-8eac-4dd1-bbeb-9e2f47de54e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:18.611054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2cda3-8eac-4dd1-bbeb-9e2f47de54e2 admin admin] PATH_INFO: `/v3/projects/ee2e995cfe564d738c96205c2a9aff37` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:18.613712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2cda3-8eac-4dd1-bbeb-9e2f47de54e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=ee2e995cfe564d738c96205c2a9aff37)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:18.683505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING keystone.common.rbac_enforcer.enforcer [None req-59e2cda3-8eac-4dd1-bbeb-9e2f47de54e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 26 00:24:18.683861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2cda3-8eac-4dd1-bbeb-9e2f47de54e2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:18.688606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 3/5] 10.222.0.88 () {56 vars in 1207 bytes} [Fri Aug 26 00:24:18 2022] GET /identity/v3/projects/ee2e995cfe564d738c96205c2a9aff37 => generated 344 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:20.634603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53041-a72a-4954-af7b-25eec04f2916 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:20.635174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53041-a72a-4954-af7b-25eec04f2916 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:20.635174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b53041-a72a-4954-af7b-25eec04f2916 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:20.639301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 3/6] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:20.644793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42726d4-aab8-4b69-b2b4-f4b07cefee7d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:20.645293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42726d4-aab8-4b69-b2b4-f4b07cefee7d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:20.645489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42726d4-aab8-4b69-b2b4-f4b07cefee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:20.671403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f42726d4-aab8-4b69-b2b4-f4b07cefee7d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:20.674066 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f42726d4-aab8-4b69-b2b4-f4b07cefee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:20.688152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 4/7] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:20 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 26 00:24:20.955006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b53041-a72a-4954-af7b-25eec04f2916 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:20.967274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b53041-a72a-4954-af7b-25eec04f2916 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:20.971810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114ad62b-bb84-4601-958f-581f7b6ae9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:20.972408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ad62b-bb84-4601-958f-581f7b6ae9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:20.973541 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ad62b-bb84-4601-958f-581f7b6ae9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:20.974027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114ad62b-bb84-4601-958f-581f7b6ae9ce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:20.981758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ad62b-bb84-4601-958f-581f7b6ae9ce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:20.983591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114ad62b-bb84-4601-958f-581f7b6ae9ce admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:20.993480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 4/8] 10.222.0.88 () {58 vars in 1324 bytes} [Fri Aug 26 00:24:20 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 00:24:20.999479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42726d4-aab8-4b69-b2b4-f4b07cefee7d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:21.009352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42726d4-aab8-4b69-b2b4-f4b07cefee7d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:21.013796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4824e2-f039-45a6-b1ab-1fcd62080545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:21.014459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4824e2-f039-45a6-b1ab-1fcd62080545 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:21.014739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4824e2-f039-45a6-b1ab-1fcd62080545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:21.015016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4824e2-f039-45a6-b1ab-1fcd62080545 admin admin] PATH_INFO: `/v3/users/0452b4d415d54cb5a7206cef55d400d5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:21.016368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4824e2-f039-45a6-b1ab-1fcd62080545 admin admin] RBAC: Authorizing `identity:get_user(user_id=0452b4d415d54cb5a7206cef55d400d5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:21.018256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4824e2-f039-45a6-b1ab-1fcd62080545 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:21.019867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 5/9] 10.222.0.88 () {56 vars in 1198 bytes} [Fri Aug 26 00:24:20 2022] GET /identity/v3/users/0452b4d415d54cb5a7206cef55d400d5 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:22.983818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f425c-5740-4b12-83c7-afbb82959f81 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:22.984364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f425c-5740-4b12-83c7-afbb82959f81 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:22.984364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841f425c-5740-4b12-83c7-afbb82959f81 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:22.985688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 5/10] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:22.991031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de7b5-1ee1-47ef-9f34-401ba33d1949 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:22.991455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de7b5-1ee1-47ef-9f34-401ba33d1949 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:22.991586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2de7b5-1ee1-47ef-9f34-401ba33d1949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:23.009718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2e2de7b5-1ee1-47ef-9f34-401ba33d1949 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:23.010948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2e2de7b5-1ee1-47ef-9f34-401ba33d1949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:23.056055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d190-c65b-449c-950c-7b8e0441beeb None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:23.056341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d190-c65b-449c-950c-7b8e0441beeb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:23.057054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6d190-c65b-449c-950c-7b8e0441beeb None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:23.058425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 6/11] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:24:23.063527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:23.063817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:23.064219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:23.104340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 6/12] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:23.108120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG passlib.handlers.bcrypt [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81540) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 26 00:24:23.108596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG passlib.handlers.bcrypt [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81540) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 26 00:24:23.154153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:23.155768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:23.254974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 7/13] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:23.378478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2de7b5-1ee1-47ef-9f34-401ba33d1949 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:23.405332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:23.492651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2de7b5-1ee1-47ef-9f34-401ba33d1949 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:23.520391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:23.529952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c032c-901d-410c-89a7-075e58e01f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:23.530608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c032c-901d-410c-89a7-075e58e01f12 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:23.530897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c032c-901d-410c-89a7-075e58e01f12 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:23.531180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c032c-901d-410c-89a7-075e58e01f12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:23.546658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c032c-901d-410c-89a7-075e58e01f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e34c032c-901d-410c-89a7-075e58e01f12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:23.563335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:23.564375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:23.565197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 7/14] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:24:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:23.572503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c032c-901d-410c-89a7-075e58e01f12 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:23.632297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814661a8-f4f7-4cc2-8150-62b8ac65a7f1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:23.634689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:23.655411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:23.671950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e42ef-edfa-4d27-a283-cd922320dee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:23.672827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e42ef-edfa-4d27-a283-cd922320dee8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:23.673116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e42ef-edfa-4d27-a283-cd922320dee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:23.673398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e42ef-edfa-4d27-a283-cd922320dee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:23.674337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c032c-901d-410c-89a7-075e58e01f12 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:23.713171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:23.713786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:23.714102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:23.714381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:23.715065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:23.715370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:23.716777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:23.729802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 8/15] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:23.735548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:23.746898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e42ef-edfa-4d27-a283-cd922320dee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:23.748431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e42ef-edfa-4d27-a283-cd922320dee8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:23.838634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cff32b-7e6c-4d84-a186-a812260c81bc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:23.850685 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 8/16] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:24:23.857954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e42ef-edfa-4d27-a283-cd922320dee8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:23.860841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:23.874514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3004-2205-4873-aacb-ca9e2e52fc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:23.875435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3004-2205-4873-aacb-ca9e2e52fc1f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:23.875864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3004-2205-4873-aacb-ca9e2e52fc1f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:23.876246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954d3004-2205-4873-aacb-ca9e2e52fc1f None admin] PATH_INFO: `/v3/users/0452b4d415d54cb5a7206cef55d400d5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:23.877421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3004-2205-4873-aacb-ca9e2e52fc1f None admin] RBAC: Authorizing `identity:get_user(user_id=0452b4d415d54cb5a7206cef55d400d5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:23.879651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954d3004-2205-4873-aacb-ca9e2e52fc1f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:23.881550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 9/17] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:23 2022] GET /identity/v3/users/0452b4d415d54cb5a7206cef55d400d5 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:23.888420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3004-2205-4873-aacb-ca9e2e52fc1f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:23.904316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:23.963120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e42ef-edfa-4d27-a283-cd922320dee8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:23.994999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954d3004-2205-4873-aacb-ca9e2e52fc1f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:23.998298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:23.999445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:23.999734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:24.000062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:24.019566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:24.021308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:24.028219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b78f-c5e6-4043-a422-64ec2631969b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:24.028850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b78f-c5e6-4043-a422-64ec2631969b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:24.029131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b78f-c5e6-4043-a422-64ec2631969b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:24.029402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b0b78f-c5e6-4043-a422-64ec2631969b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:24.030629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b78f-c5e6-4043-a422-64ec2631969b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:24.032113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b0b78f-c5e6-4043-a422-64ec2631969b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:24.033692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 10/18] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:24:24.040065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:24.041098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:24:24.041947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:24:24.041947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:24:24.041947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:24.042114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b78f-c5e6-4043-a422-64ec2631969b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:24.042188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 9/19] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:24:24.046678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:24.107306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:24.122283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:24.142630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b0b78f-c5e6-4043-a422-64ec2631969b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:24.153581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35e2ee-cfde-4439-9ba1-5b1fdd4b1bf5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:24.179002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cca300-63cc-4f5d-bedf-b0887433fa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:24.179625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca300-63cc-4f5d-bedf-b0887433fa2b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:24.179911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca300-63cc-4f5d-bedf-b0887433fa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:24.180192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cca300-63cc-4f5d-bedf-b0887433fa2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:24.180919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cca300-63cc-4f5d-bedf-b0887433fa2b None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.domain.id=default, user.id=0452b4d415d54cb5a7206cef55d400d5) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:24.181232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cca300-63cc-4f5d-bedf-b0887433fa2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:24.182989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cca300-63cc-4f5d-bedf-b0887433fa2b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:24.189664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 11/20] 10.222.0.88 () {56 vars in 1322 bytes} [Fri Aug 26 00:24:24 2022] GET /identity/v3/role_assignments?user.id=0452b4d415d54cb5a7206cef55d400d5&scope.domain.id=default&role.id=f21c9b5697b747d39bf8f104797da245 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:24.190071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce15f99-0f1f-468e-9c9f-1ed42976b7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:24.190686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce15f99-0f1f-468e-9c9f-1ed42976b7f7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:24.191035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce15f99-0f1f-468e-9c9f-1ed42976b7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:24.191343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce15f99-0f1f-468e-9c9f-1ed42976b7f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:24.192299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce15f99-0f1f-468e-9c9f-1ed42976b7f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:24.192614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce15f99-0f1f-468e-9c9f-1ed42976b7f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:24.194067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce15f99-0f1f-468e-9c9f-1ed42976b7f7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:24.215295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 10/21] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:26.572666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3813bb-edda-4d52-a7c7-a753ff27e7f6 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:26.572666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3813bb-edda-4d52-a7c7-a753ff27e7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:26.572666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3813bb-edda-4d52-a7c7-a753ff27e7f6 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:26.572666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 12/22] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:26.578272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe452-b27d-4e52-9f6c-9f9b424c9f17 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:26.578694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe452-b27d-4e52-9f6c-9f9b424c9f17 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:26.578877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fe452-b27d-4e52-9f6c-9f9b424c9f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:26.604036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a59ca-f761-425e-8161-946f04a40932 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:26.604332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a59ca-f761-425e-8161-946f04a40932 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:26.604606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323a59ca-f761-425e-8161-946f04a40932 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:26.605949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 13/23] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:24:26.611212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175448-7b20-4993-bd55-057fc4624962 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:26.611537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175448-7b20-4993-bd55-057fc4624962 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:26.611779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3175448-7b20-4993-bd55-057fc4624962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:26.643496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e39fe452-b27d-4e52-9f6c-9f9b424c9f17 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:26.645211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e39fe452-b27d-4e52-9f6c-9f9b424c9f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:26.652875 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d3175448-7b20-4993-bd55-057fc4624962 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:26.654102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d3175448-7b20-4993-bd55-057fc4624962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:26.782572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 14/24] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:26.785465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758d61-e620-41b5-b603-e3e558db2589 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:26.789947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758d61-e620-41b5-b603-e3e558db2589 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:26.790462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4758d61-e620-41b5-b603-e3e558db2589 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:26.791989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 15/25] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:26.803366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768e122-875c-4ff7-b849-646a714d1496 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:26.803944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768e122-875c-4ff7-b849-646a714d1496 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:26.804451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a768e122-875c-4ff7-b849-646a714d1496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:26.824225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 11/26] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:26.834909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a768e122-875c-4ff7-b849-646a714d1496 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:26.836387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a768e122-875c-4ff7-b849-646a714d1496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:26.940744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 16/27] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:27.004212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb226dd6-2901-4531-84bf-d7442df537d5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:27.004974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb226dd6-2901-4531-84bf-d7442df537d5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:27.005481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb226dd6-2901-4531-84bf-d7442df537d5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:27.007312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 12/28] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:27.012402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57736-eb9c-4e59-a54b-b6de11a5fb9b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:27.012696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57736-eb9c-4e59-a54b-b6de11a5fb9b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:27.012980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f57736-eb9c-4e59-a54b-b6de11a5fb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:27.023293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:27.039217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-75f57736-eb9c-4e59-a54b-b6de11a5fb9b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:27.040419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-75f57736-eb9c-4e59-a54b-b6de11a5fb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:27.141304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb226dd6-2901-4531-84bf-d7442df537d5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:27.243245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 17/29] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:27.289199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:27.348060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57736-eb9c-4e59-a54b-b6de11a5fb9b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:27.434668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb226dd6-2901-4531-84bf-d7442df537d5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:27.506741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:27.507832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:27.508286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:27.508725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:27.551432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:27.558842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:24:27.611212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:27.612529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:24:27.614200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:24:27.614200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:24:27.614200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:27.616065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 13/30] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 475 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:24:27.625901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:27.626054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f57736-eb9c-4e59-a54b-b6de11a5fb9b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:27.690525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67e87-a6ae-4778-9324-04890829898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:27.691081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67e87-a6ae-4778-9324-04890829898b None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:27.691411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67e87-a6ae-4778-9324-04890829898b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:27.691690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe67e87-a6ae-4778-9324-04890829898b None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:27.692360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe67e87-a6ae-4778-9324-04890829898b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:27.693758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe67e87-a6ae-4778-9324-04890829898b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:27.697536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:27.758508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:27.762981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0918e8-9611-455f-8413-671a04e1059f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:27.800733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21217d00-9eb2-41e3-9ecf-a85829b220f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:27.801755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217d00-9eb2-41e3-9ecf-a85829b220f6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:27.802302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217d00-9eb2-41e3-9ecf-a85829b220f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:27.802773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21217d00-9eb2-41e3-9ecf-a85829b220f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:27.815292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21217d00-9eb2-41e3-9ecf-a85829b220f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-21217d00-9eb2-41e3-9ecf-a85829b220f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:27.822736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:27.823562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:27.824300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:27.826693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 14/31] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:24:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:27.832589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21217d00-9eb2-41e3-9ecf-a85829b220f6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:27.837991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 18/32] 10.222.0.88 () {60 vars in 1131 bytes} [Fri Aug 26 00:24:27 2022] POST /identity/v3/roles => generated 219 bytes in 486 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:27.839339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67e87-a6ae-4778-9324-04890829898b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:27.949628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21217d00-9eb2-41e3-9ecf-a85829b220f6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:27.991843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:27.992725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:27.993160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:27.993586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:27.994471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:27.994783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:27.996515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:28.005855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe67e87-a6ae-4778-9324-04890829898b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:28.015755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 15/33] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:28.016990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:28.042232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:28.065767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48f666-04da-4e2e-864e-cf787e610a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:28.066521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f666-04da-4e2e-864e-cf787e610a37 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.066811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f666-04da-4e2e-864e-cf787e610a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.067091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48f666-04da-4e2e-864e-cf787e610a37 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.067892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48f666-04da-4e2e-864e-cf787e610a37 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:28.069434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48f666-04da-4e2e-864e-cf787e610a37 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:28.093351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 19/34] 10.222.0.88 () {60 vars in 1131 bytes} [Fri Aug 26 00:24:27 2022] POST /identity/v3/roles => generated 225 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:28.093351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dd48-c08a-4787-8da5-312b9cdb7ba3 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.093605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dd48-c08a-4787-8da5-312b9cdb7ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.093866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d8dd48-c08a-4787-8da5-312b9cdb7ba3 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.095282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 20/35] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:28.096143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8dd48-c08a-4787-8da5-312b9cdb7ba3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:28.156332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a00a5-d345-4428-865a-2144d3a4dfa2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:28.167138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:28.211388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8522fc10-b57d-45e7-a498-43c0c8ad5eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:28.212039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522fc10-b57d-45e7-a498-43c0c8ad5eb5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.212385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522fc10-b57d-45e7-a498-43c0c8ad5eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.212664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8522fc10-b57d-45e7-a498-43c0c8ad5eb5 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.213382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522fc10-b57d-45e7-a498-43c0c8ad5eb5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:28.214007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522fc10-b57d-45e7-a498-43c0c8ad5eb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:28.215791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8522fc10-b57d-45e7-a498-43c0c8ad5eb5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:28.228672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d8dd48-c08a-4787-8da5-312b9cdb7ba3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:28.233987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 16/36] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:28.238467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ee286-f0fb-461c-831c-40b7148696e6 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.239049 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ee286-f0fb-461c-831c-40b7148696e6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.239603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ee286-f0fb-461c-831c-40b7148696e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.260563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7a6ee286-f0fb-461c-831c-40b7148696e6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:28.262268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7a6ee286-f0fb-461c-831c-40b7148696e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:28.275102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162faa4-d36c-4797-862a-ded1442e5204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:28.276206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162faa4-d36c-4797-862a-ded1442e5204 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.276610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162faa4-d36c-4797-862a-ded1442e5204 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.276950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5162faa4-d36c-4797-862a-ded1442e5204 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.277672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162faa4-d36c-4797-862a-ded1442e5204 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:28.279876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5162faa4-d36c-4797-862a-ded1442e5204 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:28.319133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 21/37] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:24:28 2022] POST /identity/v3/projects => generated 301 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:28.320229 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162faa4-d36c-4797-862a-ded1442e5204 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:28.354910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 17/38] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:28.433410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286ce30-c873-4020-9f21-e816f1fc1cb8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.433746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286ce30-c873-4020-9f21-e816f1fc1cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.434004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c286ce30-c873-4020-9f21-e816f1fc1cb8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.436190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 18/39] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:24:28.442422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058b8a-5498-4056-99f7-8089f7de0826 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.442703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058b8a-5498-4056-99f7-8089f7de0826 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.443035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08058b8a-5498-4056-99f7-8089f7de0826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.452730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5162faa4-d36c-4797-862a-ded1442e5204 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:28.462473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:28.464741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-08058b8a-5498-4056-99f7-8089f7de0826 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:28.467850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-08058b8a-5498-4056-99f7-8089f7de0826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:28.471567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:28.502834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b1136-e9df-4d94-80a0-bda0d2bae6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:28.503485 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1136-e9df-4d94-80a0-bda0d2bae6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.504465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1136-e9df-4d94-80a0-bda0d2bae6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.504746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1b1136-e9df-4d94-80a0-bda0d2bae6b0 None admin] PATH_INFO: `/v3/users/0452b4d415d54cb5a7206cef55d400d5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.506800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b1136-e9df-4d94-80a0-bda0d2bae6b0 None admin] RBAC: Authorizing `identity:get_user(user_id=0452b4d415d54cb5a7206cef55d400d5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:28.508679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1b1136-e9df-4d94-80a0-bda0d2bae6b0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:28.509220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 22/40] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:28 2022] GET /identity/v3/users/0452b4d415d54cb5a7206cef55d400d5 => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:28.514527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b1136-e9df-4d94-80a0-bda0d2bae6b0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:28.567723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 19/41] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:28.633692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1b1136-e9df-4d94-80a0-bda0d2bae6b0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:28.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08058b8a-5498-4056-99f7-8089f7de0826 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:28.673066 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624f7f1-fdf6-485d-ae50-58ca55e9ccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:28.673828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624f7f1-fdf6-485d-ae50-58ca55e9ccdb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.674133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624f7f1-fdf6-485d-ae50-58ca55e9ccdb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.674416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2624f7f1-fdf6-485d-ae50-58ca55e9ccdb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.676409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624f7f1-fdf6-485d-ae50-58ca55e9ccdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:28.678137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2624f7f1-fdf6-485d-ae50-58ca55e9ccdb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:28.680097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 23/42] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:28.685331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624f7f1-fdf6-485d-ae50-58ca55e9ccdb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:28.733953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:28.777387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08058b8a-5498-4056-99f7-8089f7de0826 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:28.796430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2624f7f1-fdf6-485d-ae50-58ca55e9ccdb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:28.818162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7b6e-5f70-49a8-a5c4-59ffca8601bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:28.818794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7b6e-5f70-49a8-a5c4-59ffca8601bb None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.819080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7b6e-5f70-49a8-a5c4-59ffca8601bb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.819358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c7b6e-5f70-49a8-a5c4-59ffca8601bb None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.820044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c7b6e-5f70-49a8-a5c4-59ffca8601bb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:28.821479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c7b6e-5f70-49a8-a5c4-59ffca8601bb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:28.837348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:28.940086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e3947-b058-49de-907d-2a09d6a8d50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:28.940831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e3947-b058-49de-907d-2a09d6a8d50f None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:28.941169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e3947-b058-49de-907d-2a09d6a8d50f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:28.942017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e3947-b058-49de-907d-2a09d6a8d50f None admin] PATH_INFO: `/v3/domains/default/users/0452b4d415d54cb5a7206cef55d400d5/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:28.945318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e3947-b058-49de-907d-2a09d6a8d50f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=0452b4d415d54cb5a7206cef55d400d5, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:28.945499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e3947-b058-49de-907d-2a09d6a8d50f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:28.956624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 20/43] 10.222.0.88 () {60 vars in 1131 bytes} [Fri Aug 26 00:24:28 2022] POST /identity/v3/roles => generated 223 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:24:28.957638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7b6e-5f70-49a8-a5c4-59ffca8601bb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:28.968186 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 24/44] 10.222.0.88 () {58 vars in 1361 bytes} [Fri Aug 26 00:24:28 2022] PUT /identity/v3/domains/default/users/0452b4d415d54cb5a7206cef55d400d5/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:24:29.086559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c7b6e-5f70-49a8-a5c4-59ffca8601bb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:29.131203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c06ab5-680d-4736-a623-3a20478dd4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:29.131866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c06ab5-680d-4736-a623-3a20478dd4ec None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:29.132153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c06ab5-680d-4736-a623-3a20478dd4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:29.132432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c06ab5-680d-4736-a623-3a20478dd4ec None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:29.135018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c06ab5-680d-4736-a623-3a20478dd4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:29.136595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c06ab5-680d-4736-a623-3a20478dd4ec None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:29.138213 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 21/45] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:29.144660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e3947-b058-49de-907d-2a09d6a8d50f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:29.250994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e3947-b058-49de-907d-2a09d6a8d50f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:29.252545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:29.289294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d031-a503-4e06-ac60-9ef0d2825035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:29.289933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d031-a503-4e06-ac60-9ef0d2825035 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:29.290223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d031-a503-4e06-ac60-9ef0d2825035 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:29.290503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d031-a503-4e06-ac60-9ef0d2825035 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:29.291147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5d031-a503-4e06-ac60-9ef0d2825035 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:29.292599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5d031-a503-4e06-ac60-9ef0d2825035 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:29.319989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 25/46] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:24:29 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:30.939566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0c8f8-4dc1-480f-9c14-64d7928cde68 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:30.940061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0c8f8-4dc1-480f-9c14-64d7928cde68 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:30.940061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0c8f8-4dc1-480f-9c14-64d7928cde68 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:30.942216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 22/47] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:30.947404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd2b5-3f49-4b24-b7ae-4788244db377 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:30.947788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd2b5-3f49-4b24-b7ae-4788244db377 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:30.948222 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461bd2b5-3f49-4b24-b7ae-4788244db377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:30.966580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-461bd2b5-3f49-4b24-b7ae-4788244db377 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:30.968110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-461bd2b5-3f49-4b24-b7ae-4788244db377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:31.037638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 26/48] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:31.255156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882f78-1642-46f9-bbb7-fc15d8f96755 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:31.255451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882f78-1642-46f9-bbb7-fc15d8f96755 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:31.255734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44882f78-1642-46f9-bbb7-fc15d8f96755 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:31.257086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 23/49] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:31.262255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655276b2-1a33-43c9-a47c-7ef233cc48ff None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:31.262551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655276b2-1a33-43c9-a47c-7ef233cc48ff None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:31.262833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655276b2-1a33-43c9-a47c-7ef233cc48ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:31.281786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-655276b2-1a33-43c9-a47c-7ef233cc48ff None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:31.283015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-655276b2-1a33-43c9-a47c-7ef233cc48ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:31.310300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44882f78-1642-46f9-bbb7-fc15d8f96755 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:31.352521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 27/50] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:31.379109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:31.414473 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44882f78-1642-46f9-bbb7-fc15d8f96755 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:31.449163 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed88de-a6a9-400a-a9af-fc3e5702cf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:31.449794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed88de-a6a9-400a-a9af-fc3e5702cf31 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:31.450109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed88de-a6a9-400a-a9af-fc3e5702cf31 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:31.450389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed88de-a6a9-400a-a9af-fc3e5702cf31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:31.460525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed88de-a6a9-400a-a9af-fc3e5702cf31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-47ed88de-a6a9-400a-a9af-fc3e5702cf31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:31.465380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:31.466397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:31.467195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 24/51] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:24:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:24:31.472795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655276b2-1a33-43c9-a47c-7ef233cc48ff None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:31.488737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:31.571695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655276b2-1a33-43c9-a47c-7ef233cc48ff None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:31.607877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:31.608485 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:31.608771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:31.609053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:31.609730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:31.610084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:31.611494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:31.619938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 28/52] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:31.623936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed88de-a6a9-400a-a9af-fc3e5702cf31 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:31.625283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:31.710903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:31.736026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff068f6-01b2-4247-82d5-31a2390fff44 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:31.773182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5c77-f67c-4cc6-865a-5058cf1ac7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:31.773834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5c77-f67c-4cc6-865a-5058cf1ac7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:31.774153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5c77-f67c-4cc6-865a-5058cf1ac7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:31.774429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e5c77-f67c-4cc6-865a-5058cf1ac7d1 None admin] PATH_INFO: `/v3/users/0452b4d415d54cb5a7206cef55d400d5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:31.775627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e5c77-f67c-4cc6-865a-5058cf1ac7d1 None admin] RBAC: Authorizing `identity:get_user(user_id=0452b4d415d54cb5a7206cef55d400d5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:31.777247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e5c77-f67c-4cc6-865a-5058cf1ac7d1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:31.778914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 29/53] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:31 2022] GET /identity/v3/users/0452b4d415d54cb5a7206cef55d400d5 => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:31.784662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5c77-f67c-4cc6-865a-5058cf1ac7d1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:31.837113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed88de-a6a9-400a-a9af-fc3e5702cf31 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:31.864364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:31.872665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f46b05-1b62-47be-9b5f-0c83e18d3bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:31.873301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f46b05-1b62-47be-9b5f-0c83e18d3bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:31.873594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f46b05-1b62-47be-9b5f-0c83e18d3bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:31.873905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f46b05-1b62-47be-9b5f-0c83e18d3bd0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:31.875031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f46b05-1b62-47be-9b5f-0c83e18d3bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:31.876502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f46b05-1b62-47be-9b5f-0c83e18d3bd0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:31.878118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 25/54] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:31.884093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f46b05-1b62-47be-9b5f-0c83e18d3bd0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:31.886673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e5c77-f67c-4cc6-865a-5058cf1ac7d1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:31.923947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df438e71-7466-4e49-95a4-96a6c01658f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:31.924582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df438e71-7466-4e49-95a4-96a6c01658f6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:31.924872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df438e71-7466-4e49-95a4-96a6c01658f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:31.925153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df438e71-7466-4e49-95a4-96a6c01658f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:31.926738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df438e71-7466-4e49-95a4-96a6c01658f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:31.928216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df438e71-7466-4e49-95a4-96a6c01658f6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:31.929806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 30/55] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:31.935880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df438e71-7466-4e49-95a4-96a6c01658f6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:31.951005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:31.987679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f46b05-1b62-47be-9b5f-0c83e18d3bd0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:32.023821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff83f7-08a3-44b5-a068-5f135366a1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:32.024438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff83f7-08a3-44b5-a068-5f135366a1e8 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:32.024728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff83f7-08a3-44b5-a068-5f135366a1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:32.025017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff83f7-08a3-44b5-a068-5f135366a1e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:32.025664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff83f7-08a3-44b5-a068-5f135366a1e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:32.027173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff83f7-08a3-44b5-a068-5f135366a1e8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:32.039374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df438e71-7466-4e49-95a4-96a6c01658f6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:32.056284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 26/56] 10.222.0.88 () {60 vars in 1140 bytes} [Fri Aug 26 00:24:31 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:24:32.076882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa392246-cbf7-4720-bcaa-ecdcdeaa5212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:32.077414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa392246-cbf7-4720-bcaa-ecdcdeaa5212 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:32.077627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa392246-cbf7-4720-bcaa-ecdcdeaa5212 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:32.077934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa392246-cbf7-4720-bcaa-ecdcdeaa5212 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:32.078704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa392246-cbf7-4720-bcaa-ecdcdeaa5212 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.domain.id=default, user.id=0452b4d415d54cb5a7206cef55d400d5) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:32.079022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa392246-cbf7-4720-bcaa-ecdcdeaa5212 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:32.080538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa392246-cbf7-4720-bcaa-ecdcdeaa5212 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:32.088130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 31/57] 10.222.0.88 () {56 vars in 1322 bytes} [Fri Aug 26 00:24:31 2022] GET /identity/v3/role_assignments?user.id=0452b4d415d54cb5a7206cef55d400d5&scope.domain.id=default&role.id=f21c9b5697b747d39bf8f104797da245 => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:33.968489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c2ea-8c21-4e5f-a4c7-f711d8c07f22 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:33.968991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c2ea-8c21-4e5f-a4c7-f711d8c07f22 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:33.969097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a44c2ea-8c21-4e5f-a4c7-f711d8c07f22 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:33.970431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 27/58] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:33.976593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282677bd-0cae-4916-8396-47ba12839155 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:33.976989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282677bd-0cae-4916-8396-47ba12839155 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:33.977157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282677bd-0cae-4916-8396-47ba12839155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:33.995141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-282677bd-0cae-4916-8396-47ba12839155 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:33.996351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-282677bd-0cae-4916-8396-47ba12839155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:34.063801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 32/59] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:34.339852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44c2ea-8c21-4e5f-a4c7-f711d8c07f22 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:34.388955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:34.440765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a44c2ea-8c21-4e5f-a4c7-f711d8c07f22 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:34.476434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e079a245-0584-491d-ab94-dfebd0a33f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:34.477058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a245-0584-491d-ab94-dfebd0a33f43 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:34.477349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a245-0584-491d-ab94-dfebd0a33f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:34.477620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e079a245-0584-491d-ab94-dfebd0a33f43 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:34.478775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079a245-0584-491d-ab94-dfebd0a33f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:34.480246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e079a245-0584-491d-ab94-dfebd0a33f43 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:34.481795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 28/60] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:34.487436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282677bd-0cae-4916-8396-47ba12839155 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:34.495744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:34.587568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282677bd-0cae-4916-8396-47ba12839155 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:34.620443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed12a02-4c66-4524-a00d-80ec8813b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:34.620980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12a02-4c66-4524-a00d-80ec8813b502 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:34.621265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12a02-4c66-4524-a00d-80ec8813b502 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:34.621543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed12a02-4c66-4524-a00d-80ec8813b502 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:34.622231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed12a02-4c66-4524-a00d-80ec8813b502 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:34.623708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed12a02-4c66-4524-a00d-80ec8813b502 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:34.649622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 33/61] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:24:34 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:37.652684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3837f5-7c81-49cb-860f-5a54c0bcd646 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:37.653474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3837f5-7c81-49cb-860f-5a54c0bcd646 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:37.653474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3837f5-7c81-49cb-860f-5a54c0bcd646 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:37.654934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 29/62] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:24:37.660969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063171f-a0f5-4ad7-99ea-2fd396567c05 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:37.661966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063171f-a0f5-4ad7-99ea-2fd396567c05 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:37.662443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063171f-a0f5-4ad7-99ea-2fd396567c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:37.691438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f063171f-a0f5-4ad7-99ea-2fd396567c05 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:37.693197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f063171f-a0f5-4ad7-99ea-2fd396567c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:37.765102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:37.777925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 34/63] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:38.094557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3837f5-7c81-49cb-860f-5a54c0bcd646 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:38.122401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b52d-f269-4de4-b71d-123d50f1c445 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.122732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b52d-f269-4de4-b71d-123d50f1c445 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.122972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c27b52d-f269-4de4-b71d-123d50f1c445 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.124635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 35/64] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:38.130658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecd72-33c3-4dc1-81a8-a377bc41ee19 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.131018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecd72-33c3-4dc1-81a8-a377bc41ee19 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.131216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6ecd72-33c3-4dc1-81a8-a377bc41ee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.158169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9a6ecd72-33c3-4dc1-81a8-a377bc41ee19 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:38.159397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9a6ecd72-33c3-4dc1-81a8-a377bc41ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:38.229602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3837f5-7c81-49cb-860f-5a54c0bcd646 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:38.240838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 36/65] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:38.242171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce07c9-9b9d-4463-aca9-ed18835c5071 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.242465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce07c9-9b9d-4463-aca9-ed18835c5071 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.242937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ce07c9-9b9d-4463-aca9-ed18835c5071 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.244664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 37/66] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:38.246044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e9f9-a217-41cb-9312-188b65eafad5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.246530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e9f9-a217-41cb-9312-188b65eafad5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.247007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c98e9f9-a217-41cb-9312-188b65eafad5 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.248429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 38/67] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:38.251662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec990f87-5560-4e48-ad10-2ad5efbc7107 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.252163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec990f87-5560-4e48-ad10-2ad5efbc7107 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.252637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec990f87-5560-4e48-ad10-2ad5efbc7107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.260032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:38.272849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ec990f87-5560-4e48-ad10-2ad5efbc7107 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:38.274621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ec990f87-5560-4e48-ad10-2ad5efbc7107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:38.281797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d8800-9e0d-4758-813e-d44c331903e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:38.282533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8800-9e0d-4758-813e-d44c331903e6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.282830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8800-9e0d-4758-813e-d44c331903e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.283116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d8800-9e0d-4758-813e-d44c331903e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.295818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d8800-9e0d-4758-813e-d44c331903e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b06d8800-9e0d-4758-813e-d44c331903e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:38.301655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:38.302567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:38.303309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 30/68] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:38.309488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff72de-525a-48d6-9c3e-528e033280d5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.309488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff72de-525a-48d6-9c3e-528e033280d5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.309488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ff72de-525a-48d6-9c3e-528e033280d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.325635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-73ff72de-525a-48d6-9c3e-528e033280d5 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:38.327217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-73ff72de-525a-48d6-9c3e-528e033280d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:38.364917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 39/69] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:38.366298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec990f87-5560-4e48-ad10-2ad5efbc7107 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:38.434376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 31/70] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:38.458552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:38.511714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec990f87-5560-4e48-ad10-2ad5efbc7107 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:38.539447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff72de-525a-48d6-9c3e-528e033280d5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:38.567833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:38.568474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.568764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.569065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.575921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:38.577462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:38.579257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:38.598629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 40/71] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:38.604493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:38.704243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ff72de-525a-48d6-9c3e-528e033280d5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:38.711392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:38.742666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70a9c9-c8de-4930-a69d-ab4239fd1df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:38.743306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a9c9-c8de-4930-a69d-ab4239fd1df7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.743597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a9c9-c8de-4930-a69d-ab4239fd1df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.743873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed70a9c9-c8de-4930-a69d-ab4239fd1df7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.750717 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d55b9-bfb8-477c-8a21-01c4b2ee2f75 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:38.755367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed70a9c9-c8de-4930-a69d-ab4239fd1df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ed70a9c9-c8de-4930-a69d-ab4239fd1df7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:38.760151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:38.761025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:38.761774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 32/72] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:38.762450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70a9c9-c8de-4930-a69d-ab4239fd1df7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:38.771137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:38.793466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6329cd4f-6a9b-4059-a7eb-f3b57f43e0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:38.794145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329cd4f-6a9b-4059-a7eb-f3b57f43e0ec None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.794432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329cd4f-6a9b-4059-a7eb-f3b57f43e0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.794716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6329cd4f-6a9b-4059-a7eb-f3b57f43e0ec None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.808903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329cd4f-6a9b-4059-a7eb-f3b57f43e0ec None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:38.810427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6329cd4f-6a9b-4059-a7eb-f3b57f43e0ec None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:38.812059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 41/73] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:38 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:38.814451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e846b6-4ff1-4494-9403-0df7e47f64fe None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.814748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e846b6-4ff1-4494-9403-0df7e47f64fe None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.815035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e846b6-4ff1-4494-9403-0df7e47f64fe None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.816466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 42/74] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:38.817198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e846b6-4ff1-4494-9403-0df7e47f64fe None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:38.876432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed70a9c9-c8de-4930-a69d-ab4239fd1df7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:38.912087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39775b94-95c5-43b1-9582-bc8bc376e5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:38.912721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39775b94-95c5-43b1-9582-bc8bc376e5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.913006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39775b94-95c5-43b1-9582-bc8bc376e5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.913288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39775b94-95c5-43b1-9582-bc8bc376e5d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.921715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e846b6-4ff1-4494-9403-0df7e47f64fe None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:38.923379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39775b94-95c5-43b1-9582-bc8bc376e5d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-39775b94-95c5-43b1-9582-bc8bc376e5d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:38.928793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:38.929659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:38.930459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 33/75] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:24:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:38.931228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39775b94-95c5-43b1-9582-bc8bc376e5d2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:38.958889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:38.959057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:38.959656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:38.959947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:38.960232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:38.960974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:38.961305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:38.962876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:38.971128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 43/76] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:38.971957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.007836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.037933 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39775b94-95c5-43b1-9582-bc8bc376e5d2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.073364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0178ee-1eca-4b46-bde6-42b260c11c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.074111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0178ee-1eca-4b46-bde6-42b260c11c87 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.074403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0178ee-1eca-4b46-bde6-42b260c11c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.074688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0178ee-1eca-4b46-bde6-42b260c11c87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.079421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65611749-9b86-4536-8e88-2937c457ce39 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.085741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0178ee-1eca-4b46-bde6-42b260c11c87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8f0178ee-1eca-4b46-bde6-42b260c11c87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:39.090571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:39.091394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:39.092127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 34/77] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:39.092960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128c19-2e92-40bf-b0b4-ab12b0daa790 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.093270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128c19-2e92-40bf-b0b4-ab12b0daa790 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.093537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69128c19-2e92-40bf-b0b4-ab12b0daa790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.111118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-69128c19-2e92-40bf-b0b4-ab12b0daa790 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:39.112422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-69128c19-2e92-40bf-b0b4-ab12b0daa790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:39.116074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cc340-d310-437e-824c-19a8b9f92b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.116693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc340-d310-437e-824c-19a8b9f92b18 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.116985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc340-d310-437e-824c-19a8b9f92b18 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.117267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9cc340-d310-437e-824c-19a8b9f92b18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.180372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 35/78] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:39.181230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69128c19-2e92-40bf-b0b4-ab12b0daa790 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.192541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cc340-d310-437e-824c-19a8b9f92b18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.194090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9cc340-d310-437e-824c-19a8b9f92b18 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.201240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.230202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.289914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69128c19-2e92-40bf-b0b4-ab12b0daa790 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.307366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 44/79] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:39.308053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cc340-d310-437e-824c-19a8b9f92b18 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.328791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.329408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.329703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.330014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.330700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:39.331012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.332528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.344993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 36/80] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:39.344993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.422549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9cc340-d310-437e-824c-19a8b9f92b18 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.424489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.448486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a77e5f-a12e-4be9-9e39-666514d7b482 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.465751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81775f3f-2be2-4013-8d5b-2b61ca1f5323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.466919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775f3f-2be2-4013-8d5b-2b61ca1f5323 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.467220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775f3f-2be2-4013-8d5b-2b61ca1f5323 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.467507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81775f3f-2be2-4013-8d5b-2b61ca1f5323 None admin] PATH_INFO: `/v3/users/0452b4d415d54cb5a7206cef55d400d5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.468666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81775f3f-2be2-4013-8d5b-2b61ca1f5323 None admin] RBAC: Authorizing `identity:get_user(user_id=0452b4d415d54cb5a7206cef55d400d5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.470168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81775f3f-2be2-4013-8d5b-2b61ca1f5323 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.471767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 45/81] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/users/0452b4d415d54cb5a7206cef55d400d5 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:39.473440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81775f3f-2be2-4013-8d5b-2b61ca1f5323 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.476075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.487323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.488419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.488703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.488978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.489648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:39.490019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.491406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.499595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 37/82] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:39.500394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.584673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81775f3f-2be2-4013-8d5b-2b61ca1f5323 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.600698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b979fa-a797-4285-8214-b45dd4c1e929 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.619622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a0bca-111c-4542-9c2f-67ef5a874f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.620257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a0bca-111c-4542-9c2f-67ef5a874f94 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.620549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a0bca-111c-4542-9c2f-67ef5a874f94 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.620834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a0bca-111c-4542-9c2f-67ef5a874f94 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.621984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a0bca-111c-4542-9c2f-67ef5a874f94 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.623466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a0bca-111c-4542-9c2f-67ef5a874f94 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.625096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 46/83] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:39.625865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a0bca-111c-4542-9c2f-67ef5a874f94 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.640079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03755b5c-639f-4ac2-b012-da63c18f5416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.640724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755b5c-639f-4ac2-b012-da63c18f5416 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.641015 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755b5c-639f-4ac2-b012-da63c18f5416 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.641299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03755b5c-639f-4ac2-b012-da63c18f5416 None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.642792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03755b5c-639f-4ac2-b012-da63c18f5416 None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.644423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03755b5c-639f-4ac2-b012-da63c18f5416 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.646207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 38/84] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:39.646981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03755b5c-639f-4ac2-b012-da63c18f5416 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.658425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.699649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.732295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a0bca-111c-4542-9c2f-67ef5a874f94 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.748404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03755b5c-639f-4ac2-b012-da63c18f5416 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.765941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8e500-e96b-4ee7-b872-622e66b6c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.766652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e500-e96b-4ee7-b872-622e66b6c732 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.766942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e500-e96b-4ee7-b872-622e66b6c732 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.767224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8e500-e96b-4ee7-b872-622e66b6c732 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.768346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8e500-e96b-4ee7-b872-622e66b6c732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.769852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8e500-e96b-4ee7-b872-622e66b6c732 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.771467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 47/85] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:39.772243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8e500-e96b-4ee7-b872-622e66b6c732 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.782574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f7f83-8c55-4a9f-ada2-a7f59d113dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.783192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7f83-8c55-4a9f-ada2-a7f59d113dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.783485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7f83-8c55-4a9f-ada2-a7f59d113dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.783769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109f7f83-8c55-4a9f-ada2-a7f59d113dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.852841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f7f83-8c55-4a9f-ada2-a7f59d113dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.854372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109f7f83-8c55-4a9f-ada2-a7f59d113dc7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.864675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.892253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8e500-e96b-4ee7-b872-622e66b6c732 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:39.926541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37db6d0-aee1-4c32-96ae-c4db6e98c0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:39.927169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db6d0-aee1-4c32-96ae-c4db6e98c0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:39.927456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db6d0-aee1-4c32-96ae-c4db6e98c0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:39.927734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37db6d0-aee1-4c32-96ae-c4db6e98c0c9 None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:39.928873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37db6d0-aee1-4c32-96ae-c4db6e98c0c9 None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:39.930384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37db6d0-aee1-4c32-96ae-c4db6e98c0c9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:39.932245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 48/86] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:39.933018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37db6d0-aee1-4c32-96ae-c4db6e98c0c9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:39.943255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:39.960831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 39/87] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:39.961664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f7f83-8c55-4a9f-ada2-a7f59d113dc7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.039943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37db6d0-aee1-4c32-96ae-c4db6e98c0c9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:40.060294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109f7f83-8c55-4a9f-ada2-a7f59d113dc7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:40.070232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:40.075787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:40.076404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:40.076692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:40.076972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:40.077703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] RBAC: Adding query filter params (role.id=e104332d9de24bed8d32257cab931633, scope.project.id=0984058b3d114dee94ef957c8703fd0a, user.id=ae1358b70c5d4155a112c19691b493c9) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:40.078053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:40.079604 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:40.085209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 49/88] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/role_assignments?user.id=ae1358b70c5d4155a112c19691b493c9&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=e104332d9de24bed8d32257cab931633 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:40.086067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.101103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78738eea-d942-4586-94a4-eb03d167cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:40.101743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738eea-d942-4586-94a4-eb03d167cf40 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:40.102059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738eea-d942-4586-94a4-eb03d167cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:40.102344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78738eea-d942-4586-94a4-eb03d167cf40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:40.179913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:40.181691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78738eea-d942-4586-94a4-eb03d167cf40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:40.183323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78738eea-d942-4586-94a4-eb03d167cf40 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:40.217128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67703e2-ba51-4bb6-92e9-0102ec9e8932 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:40.255550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e313e52-4a2d-4f6f-8bce-f469dc5226d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:40.256181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e313e52-4a2d-4f6f-8bce-f469dc5226d4 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:40.256480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e313e52-4a2d-4f6f-8bce-f469dc5226d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:40.256770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e313e52-4a2d-4f6f-8bce-f469dc5226d4 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:40.257443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e313e52-4a2d-4f6f-8bce-f469dc5226d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:40.259106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e313e52-4a2d-4f6f-8bce-f469dc5226d4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:40.283298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 50/89] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:24:40 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:40.284201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e313e52-4a2d-4f6f-8bce-f469dc5226d4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.314389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 40/90] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:40.316275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78738eea-d942-4586-94a4-eb03d167cf40 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.332894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:40.410015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e313e52-4a2d-4f6f-8bce-f469dc5226d4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:40.444179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:40.453346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36f367-4d22-4834-be01-c8859cde2d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:40.454776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36f367-4d22-4834-be01-c8859cde2d91 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:40.454952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36f367-4d22-4834-be01-c8859cde2d91 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:40.455189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36f367-4d22-4834-be01-c8859cde2d91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:40.467376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78738eea-d942-4586-94a4-eb03d167cf40 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:40.512782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819e9b-ad4b-40e0-9da9-92defef78198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:40.513472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819e9b-ad4b-40e0-9da9-92defef78198 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:40.513989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819e9b-ad4b-40e0-9da9-92defef78198 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:40.514278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd819e9b-ad4b-40e0-9da9-92defef78198 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:40.515462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd819e9b-ad4b-40e0-9da9-92defef78198 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:40.516935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd819e9b-ad4b-40e0-9da9-92defef78198 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:40.518712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 41/91] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:40 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:40.519604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819e9b-ad4b-40e0-9da9-92defef78198 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.545360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36f367-4d22-4834-be01-c8859cde2d91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:40.546948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36f367-4d22-4834-be01-c8859cde2d91 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:40.621739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:40.655233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd819e9b-ad4b-40e0-9da9-92defef78198 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:40.686947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 51/92] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:40.687841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36f367-4d22-4834-be01-c8859cde2d91 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.702398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbd01d-7cfa-4133-8e0d-b0d542de8650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:40.703020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd01d-7cfa-4133-8e0d-b0d542de8650 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:40.703313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd01d-7cfa-4133-8e0d-b0d542de8650 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:40.703596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bbd01d-7cfa-4133-8e0d-b0d542de8650 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:40.704771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbd01d-7cfa-4133-8e0d-b0d542de8650 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:40.706909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bbd01d-7cfa-4133-8e0d-b0d542de8650 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:40.709094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 42/93] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:40 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:40.709696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbd01d-7cfa-4133-8e0d-b0d542de8650 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.725906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:40.841141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bbd01d-7cfa-4133-8e0d-b0d542de8650 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:40.844126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36f367-4d22-4834-be01-c8859cde2d91 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:40.905355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66b64b-b9bd-4d74-ad74-1234866449fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:40.906037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b64b-b9bd-4d74-ad74-1234866449fb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:40.906329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b64b-b9bd-4d74-ad74-1234866449fb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:40.906611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66b64b-b9bd-4d74-ad74-1234866449fb None admin] PATH_INFO: `/v3/projects/a04e5619c693481d9f69744c3718da18` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:40.908855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66b64b-b9bd-4d74-ad74-1234866449fb None admin] RBAC: Authorizing `identity:get_project(project_id=a04e5619c693481d9f69744c3718da18)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:40.910553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66b64b-b9bd-4d74-ad74-1234866449fb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:40.912424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 43/94] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:40 2022] GET /identity/v3/projects/a04e5619c693481d9f69744c3718da18 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:40.912984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66b64b-b9bd-4d74-ad74-1234866449fb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.916247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:40.917042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:40.917158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:40.917415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:40.918196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=0984058b3d114dee94ef957c8703fd0a, user.id=0452b4d415d54cb5a7206cef55d400d5) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:40.918513 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:40.919969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:40.927075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 52/95] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:40 2022] GET /identity/v3/role_assignments?user.id=0452b4d415d54cb5a7206cef55d400d5&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=f21c9b5697b747d39bf8f104797da245 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:40.927919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:40.950741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:41.124618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:41.139642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff928ed-01c3-4a0f-9cd0-dd5aa0965493 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:41.155969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66b64b-b9bd-4d74-ad74-1234866449fb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:41.196040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ea4a3-b6db-45f3-9066-b5243f44d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:41.197001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ea4a3-b6db-45f3-9066-b5243f44d9a5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:41.197584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ea4a3-b6db-45f3-9066-b5243f44d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:41.198086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ea4a3-b6db-45f3-9066-b5243f44d9a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:41.199270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ea4a3-b6db-45f3-9066-b5243f44d9a5 None admin] RBAC: Adding query filter params (role.id=e104332d9de24bed8d32257cab931633, scope.project.id=a04e5619c693481d9f69744c3718da18, user.id=ae1358b70c5d4155a112c19691b493c9) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:41.199776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ea4a3-b6db-45f3-9066-b5243f44d9a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:41.201427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58ea4a3-b6db-45f3-9066-b5243f44d9a5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:41.213744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 53/96] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:40 2022] GET /identity/v3/role_assignments?user.id=ae1358b70c5d4155a112c19691b493c9&scope.project.id=a04e5619c693481d9f69744c3718da18&role.id=e104332d9de24bed8d32257cab931633 => generated 259 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:41.237556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2131d2-ae7b-4037-b5cc-2bd40c792962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:41.238226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2131d2-ae7b-4037-b5cc-2bd40c792962 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:41.238512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2131d2-ae7b-4037-b5cc-2bd40c792962 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:41.238789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2131d2-ae7b-4037-b5cc-2bd40c792962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:41.239560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2131d2-ae7b-4037-b5cc-2bd40c792962 None admin] RBAC: Adding query filter params (role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=0984058b3d114dee94ef957c8703fd0a, user.id=ae1358b70c5d4155a112c19691b493c9) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:41.239884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2131d2-ae7b-4037-b5cc-2bd40c792962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:41.241384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2131d2-ae7b-4037-b5cc-2bd40c792962 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:41.258302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 44/97] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:40 2022] GET /identity/v3/role_assignments?user.id=ae1358b70c5d4155a112c19691b493c9&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 259 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:42.405040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20845f7b-28b3-4494-8af9-8e8a5c8a9403 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:42.405553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20845f7b-28b3-4494-8af9-8e8a5c8a9403 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:42.405625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20845f7b-28b3-4494-8af9-8e8a5c8a9403 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:42.407146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 54/98] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:42.412315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df0324-88b8-4d08-ab2e-61d4e37a6d28 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:42.412778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df0324-88b8-4d08-ab2e-61d4e37a6d28 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:42.412853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df0324-88b8-4d08-ab2e-61d4e37a6d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:42.437993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e8df0324-88b8-4d08-ab2e-61d4e37a6d28 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:42.439196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e8df0324-88b8-4d08-ab2e-61d4e37a6d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:42.530513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 45/99] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:43.065356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20845f7b-28b3-4494-8af9-8e8a5c8a9403 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:43.164926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa799b-9f3d-49dd-a23a-c7c90a0038b6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.165240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa799b-9f3d-49dd-a23a-c7c90a0038b6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.165491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fa799b-9f3d-49dd-a23a-c7c90a0038b6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.166866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 46/100] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:43.182688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0e2b1-aad1-4ec7-bfb8-3b6a686bb1c2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.182973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0e2b1-aad1-4ec7-bfb8-3b6a686bb1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.183251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0e2b1-aad1-4ec7-bfb8-3b6a686bb1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.205272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:43.217805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-86d0e2b1-aad1-4ec7-bfb8-3b6a686bb1c2 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:43.219027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-86d0e2b1-aad1-4ec7-bfb8-3b6a686bb1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:43.242024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20845f7b-28b3-4494-8af9-8e8a5c8a9403 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:43.301961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de62746-631a-46a9-a81d-34b845a4926a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:43.303037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62746-631a-46a9-a81d-34b845a4926a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.303438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62746-631a-46a9-a81d-34b845a4926a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.303819 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de62746-631a-46a9-a81d-34b845a4926a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.328164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de62746-631a-46a9-a81d-34b845a4926a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:43.329844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 47/101] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:43.331855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a007-9c4c-4ff7-b0ae-fe9096f7cafc None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.332347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a007-9c4c-4ff7-b0ae-fe9096f7cafc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.332840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18a007-9c4c-4ff7-b0ae-fe9096f7cafc None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9de62746-631a-46a9-a81d-34b845a4926a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:43.333727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:43.334568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:43.335659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 55/102] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:43.337248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 48/103] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:43.342690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7d19-f6d0-4e49-bc48-f992a003cc45 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.342976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7d19-f6d0-4e49-bc48-f992a003cc45 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.343257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a7d19-f6d0-4e49-bc48-f992a003cc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.344600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18a007-9c4c-4ff7-b0ae-fe9096f7cafc None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:43.382972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-503a7d19-f6d0-4e49-bc48-f992a003cc45 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:43.384201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-503a7d19-f6d0-4e49-bc48-f992a003cc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:43.434275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:43.497602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18a007-9c4c-4ff7-b0ae-fe9096f7cafc None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:43.518571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 56/104] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:43.547897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:43.548516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.548802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.549080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.549814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:43.550743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:43.557734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:43.560419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:43.582481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 49/105] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:43.583835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a7d19-f6d0-4e49-bc48-f992a003cc45 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:43.712989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a7d19-f6d0-4e49-bc48-f992a003cc45 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:43.760238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e3094f-64c9-4ed8-b948-ea412573b817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:43.760939 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3094f-64c9-4ed8-b948-ea412573b817 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.761228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3094f-64c9-4ed8-b948-ea412573b817 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.761507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3094f-64c9-4ed8-b948-ea412573b817 None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.762675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3094f-64c9-4ed8-b948-ea412573b817 None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:43.764140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e3094f-64c9-4ed8-b948-ea412573b817 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:43.765723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 57/106] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:43 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:43.772071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:43.836632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341122f-432e-46f6-9df0-8a7ecc9d6c68 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.836936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341122f-432e-46f6-9df0-8a7ecc9d6c68 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.837127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341122f-432e-46f6-9df0-8a7ecc9d6c68 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.838942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 58/107] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:43.848529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460820-13d3-40d8-96a0-7d540abe52b0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.848825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460820-13d3-40d8-96a0-7d540abe52b0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.849107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37460820-13d3-40d8-96a0-7d540abe52b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.874910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-37460820-13d3-40d8-96a0-7d540abe52b0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:43.876123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-37460820-13d3-40d8-96a0-7d540abe52b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:43.898282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:43.911556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4c9fa-198e-4141-9edb-28ff75af0e1b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:43.954582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d42c-a96e-443b-8562-397ec96601ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:43.955345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d42c-a96e-443b-8562-397ec96601ca None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:43.955636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d42c-a96e-443b-8562-397ec96601ca None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:43.955915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969d42c-a96e-443b-8562-397ec96601ca None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:43.958745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969d42c-a96e-443b-8562-397ec96601ca None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:43.960597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969d42c-a96e-443b-8562-397ec96601ca None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:43.962944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 50/108] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:43 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:43.968921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d42c-a96e-443b-8562-397ec96601ca None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:43.986115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 59/109] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:43.997755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37460820-13d3-40d8-96a0-7d540abe52b0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:44.081170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:44.131602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969d42c-a96e-443b-8562-397ec96601ca None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:44.146781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37460820-13d3-40d8-96a0-7d540abe52b0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:44.172697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650535-f3ea-4350-8758-8644ac41d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:44.173705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650535-f3ea-4350-8758-8644ac41d3ce None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.174303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650535-f3ea-4350-8758-8644ac41d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.174911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5650535-f3ea-4350-8758-8644ac41d3ce None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a/users/ae1358b70c5d4155a112c19691b493c9/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.177821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5650535-f3ea-4350-8758-8644ac41d3ce None admin] RBAC: Authorizing `identity:create_grant(project_id=0984058b3d114dee94ef957c8703fd0a, user_id=ae1358b70c5d4155a112c19691b493c9, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:44.179569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5650535-f3ea-4350-8758-8644ac41d3ce None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:44.190799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c7ea3-4e15-489b-b5b4-622da06841dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:44.192766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c7ea3-4e15-489b-b5b4-622da06841dc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.193056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c7ea3-4e15-489b-b5b4-622da06841dc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.193334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c7ea3-4e15-489b-b5b4-622da06841dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.205899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 51/110] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:24:43 2022] PUT /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a/users/ae1358b70c5d4155a112c19691b493c9/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:24:44.205899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650535-f3ea-4350-8758-8644ac41d3ce None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:44.225074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c7ea3-4e15-489b-b5b4-622da06841dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-070c7ea3-4e15-489b-b5b4-622da06841dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:44.230259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:44.231171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:44.231913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 60/111] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:44.239699 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44bad-35f1-4929-9e88-f2ce4eef503c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.239896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44bad-35f1-4929-9e88-f2ce4eef503c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.240106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a44bad-35f1-4929-9e88-f2ce4eef503c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.241508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 61/112] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:44.242301 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a44bad-35f1-4929-9e88-f2ce4eef503c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:44.256992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:44.365576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5650535-f3ea-4350-8758-8644ac41d3ce None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:44.399958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:44.405517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a44bad-35f1-4929-9e88-f2ce4eef503c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:44.413408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6b701-045f-44e2-8fa9-681f4cb26bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:44.414212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b701-045f-44e2-8fa9-681f4cb26bee None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.414504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b701-045f-44e2-8fa9-681f4cb26bee None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.414793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6b701-045f-44e2-8fa9-681f4cb26bee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.415941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6b701-045f-44e2-8fa9-681f4cb26bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:44.417808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6b701-045f-44e2-8fa9-681f4cb26bee None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:44.419273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 52/113] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:44.420378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6242f-5eac-4346-9d1c-cdc263148421 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.420664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6242f-5eac-4346-9d1c-cdc263148421 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.421065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6242f-5eac-4346-9d1c-cdc263148421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.444695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:44.445373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.445668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.445971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.446710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:44.447021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:44.448487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:44.450245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-66c6242f-5eac-4346-9d1c-cdc263148421 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:44.452031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-66c6242f-5eac-4346-9d1c-cdc263148421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:44.457886 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 62/114] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:44.458636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:44.533917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 53/115] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:44.533917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6242f-5eac-4346-9d1c-cdc263148421 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:44.536603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:44.603424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddbde1-dc4c-4e0e-b793-f04b3964c7d5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:44.637255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6242f-5eac-4346-9d1c-cdc263148421 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:44.652826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10720fb-b2da-408b-8ce9-8fd5b8b0e4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:44.654197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10720fb-b2da-408b-8ce9-8fd5b8b0e4d7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.654937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10720fb-b2da-408b-8ce9-8fd5b8b0e4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.655585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10720fb-b2da-408b-8ce9-8fd5b8b0e4d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.664232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:44.673090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10720fb-b2da-408b-8ce9-8fd5b8b0e4d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:44.677076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71d7b2-1c3c-4a52-99d9-7c82c3a47ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:44.677705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d7b2-1c3c-4a52-99d9-7c82c3a47ffe None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.678026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d7b2-1c3c-4a52-99d9-7c82c3a47ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.678310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71d7b2-1c3c-4a52-99d9-7c82c3a47ffe None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.678967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71d7b2-1c3c-4a52-99d9-7c82c3a47ffe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:44.680499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71d7b2-1c3c-4a52-99d9-7c82c3a47ffe None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e10720fb-b2da-408b-8ce9-8fd5b8b0e4d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:44.680888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:44.681971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:44.682707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:44.684931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 63/116] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:44.686299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10720fb-b2da-408b-8ce9-8fd5b8b0e4d7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:44.713973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 54/117] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:24:44 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:44.715361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2fb0-7177-4b29-9363-83e1edde14e6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.715712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2fb0-7177-4b29-9363-83e1edde14e6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.716003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d2fb0-7177-4b29-9363-83e1edde14e6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.718353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 55/118] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:44.723422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d2fb0-7177-4b29-9363-83e1edde14e6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:44.841919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10720fb-b2da-408b-8ce9-8fd5b8b0e4d7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:44.876927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:44.884771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d2fb0-7177-4b29-9363-83e1edde14e6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:44.891576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5787ef96-a446-4d08-9d6e-52b26bbafde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:44.892581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787ef96-a446-4d08-9d6e-52b26bbafde7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.893063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787ef96-a446-4d08-9d6e-52b26bbafde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.894318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5787ef96-a446-4d08-9d6e-52b26bbafde7 None admin] PATH_INFO: `/v3/users/1ec7215957414d6bbe46c2fb6313e7c8` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.917094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787ef96-a446-4d08-9d6e-52b26bbafde7 None admin] RBAC: Authorizing `identity:get_user(user_id=1ec7215957414d6bbe46c2fb6313e7c8)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:44.918578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5787ef96-a446-4d08-9d6e-52b26bbafde7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:44.921545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 64/119] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:44 2022] GET /identity/v3/users/1ec7215957414d6bbe46c2fb6313e7c8 => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:44.923340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dedb7-65d6-4aba-91c0-0eb5f7f4e1f1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.923632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dedb7-65d6-4aba-91c0-0eb5f7f4e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.923913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dedb7-65d6-4aba-91c0-0eb5f7f4e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.936510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:44.937461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:44.937991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:44.938469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:44.939483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:44.939866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:44.941622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:44.946122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a12dedb7-65d6-4aba-91c0-0eb5f7f4e1f1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:44.947345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a12dedb7-65d6-4aba-91c0-0eb5f7f4e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:44.951307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 56/120] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:44.952436 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.002068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:45.038235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 65/121] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:45.039565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dedb7-65d6-4aba-91c0-0eb5f7f4e1f1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.071506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d1fa3-9274-40be-8138-109cf155bcd6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:45.111120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690bde9-c35e-47d7-8986-2d7a00643226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:45.111768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690bde9-c35e-47d7-8986-2d7a00643226 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:45.112067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690bde9-c35e-47d7-8986-2d7a00643226 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:45.112332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690bde9-c35e-47d7-8986-2d7a00643226 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:45.127050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690bde9-c35e-47d7-8986-2d7a00643226 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7690bde9-c35e-47d7-8986-2d7a00643226 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:45.134469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:45.135330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:45.136060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:45.140848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 57/122] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:24:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:45.141860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690bde9-c35e-47d7-8986-2d7a00643226 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.170228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dedb7-65d6-4aba-91c0-0eb5f7f4e1f1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:45.191643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:45.228282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9142e89-d36f-446c-ae1c-0f95e486e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:45.230198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9142e89-d36f-446c-ae1c-0f95e486e621 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:45.231908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9142e89-d36f-446c-ae1c-0f95e486e621 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:45.232512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9142e89-d36f-446c-ae1c-0f95e486e621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:45.290181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:45.302542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690bde9-c35e-47d7-8986-2d7a00643226 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:45.346995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6056d-6345-43a0-b46e-e254774004ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:45.348403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6056d-6345-43a0-b46e-e254774004ed None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:45.349184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6056d-6345-43a0-b46e-e254774004ed None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:45.349668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6056d-6345-43a0-b46e-e254774004ed None admin] PATH_INFO: `/v3/users/0452b4d415d54cb5a7206cef55d400d5` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:45.351246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6056d-6345-43a0-b46e-e254774004ed None admin] RBAC: Authorizing `identity:get_user(user_id=0452b4d415d54cb5a7206cef55d400d5)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:45.352974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6056d-6345-43a0-b46e-e254774004ed None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:45.355157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 58/123] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:45 2022] GET /identity/v3/users/0452b4d415d54cb5a7206cef55d400d5 => generated 247 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:45.356425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6056d-6345-43a0-b46e-e254774004ed None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.370406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9142e89-d36f-446c-ae1c-0f95e486e621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:45.371909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9142e89-d36f-446c-ae1c-0f95e486e621 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:45.479791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6056d-6345-43a0-b46e-e254774004ed None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:45.524369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:45.525011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:45.525302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:45.525587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:45.526321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:45.526635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:45.528528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:45.540866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 59/124] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:24:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:45.541802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.543753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 66/125] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:45.548922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9142e89-d36f-446c-ae1c-0f95e486e621 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.568800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:45.590565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:45.666034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9142e89-d36f-446c-ae1c-0f95e486e621 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:45.672688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829e52da-9de3-4a53-ade1-ba10439d37e6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:45.703714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fb652-7a46-41a0-9ab5-cd9ee909b70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:45.704602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb652-7a46-41a0-9ab5-cd9ee909b70c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:45.704995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb652-7a46-41a0-9ab5-cd9ee909b70c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:45.705670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fb652-7a46-41a0-9ab5-cd9ee909b70c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:45.710928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614270e-ca60-4bcb-b891-040f673dc0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:45.711779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614270e-ca60-4bcb-b891-040f673dc0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:45.712501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614270e-ca60-4bcb-b891-040f673dc0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:45.712923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614270e-ca60-4bcb-b891-040f673dc0e7 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:45.714445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614270e-ca60-4bcb-b891-040f673dc0e7 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:45.716051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5614270e-ca60-4bcb-b891-040f673dc0e7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:45.717411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fb652-7a46-41a0-9ab5-cd9ee909b70c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:45.718211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 60/126] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:45 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:45.719219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614270e-ca60-4bcb-b891-040f673dc0e7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-a35fb652-7a46-41a0-9ab5-cd9ee909b70c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:45.723569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:45.724463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:45.725208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 67/127] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:45.725843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fb652-7a46-41a0-9ab5-cd9ee909b70c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.810512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:45.832960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:45.839815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614270e-ca60-4bcb-b891-040f673dc0e7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:45.846369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fb652-7a46-41a0-9ab5-cd9ee909b70c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:45.877773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b094f-b499-47a5-95b5-c613f0f890af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:45.879406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b094f-b499-47a5-95b5-c613f0f890af None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:45.879924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b094f-b499-47a5-95b5-c613f0f890af None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:45.880407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8b094f-b499-47a5-95b5-c613f0f890af None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:45.881810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b094f-b499-47a5-95b5-c613f0f890af None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:45.883528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8b094f-b499-47a5-95b5-c613f0f890af None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:45.884979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac4aee-8ba0-4137-8fe7-6ce27b92e6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:45.885546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 61/128] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:45 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:45.885750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac4aee-8ba0-4137-8fe7-6ce27b92e6fa None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:45.886131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac4aee-8ba0-4137-8fe7-6ce27b92e6fa None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:45.886517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddac4aee-8ba0-4137-8fe7-6ce27b92e6fa None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:45.887019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b094f-b499-47a5-95b5-c613f0f890af None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:45.887921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac4aee-8ba0-4137-8fe7-6ce27b92e6fa None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:45.889381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddac4aee-8ba0-4137-8fe7-6ce27b92e6fa None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:45.892181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 68/129] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:45 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:45.897871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac4aee-8ba0-4137-8fe7-6ce27b92e6fa None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:46.005180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddac4aee-8ba0-4137-8fe7-6ce27b92e6fa None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:46.016761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8b094f-b499-47a5-95b5-c613f0f890af None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:46.044337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:46.045084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.045349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.045641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.046397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:46.046676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:46.048197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:46.058033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cbfe4-b66b-4c8b-ad74-c21afeb1e245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:46.058287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 69/130] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:46.059040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:46.059576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cbfe4-b66b-4c8b-ad74-c21afeb1e245 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.060057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cbfe4-b66b-4c8b-ad74-c21afeb1e245 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.060589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772cbfe4-b66b-4c8b-ad74-c21afeb1e245 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a/users/0452b4d415d54cb5a7206cef55d400d5/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.065313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cbfe4-b66b-4c8b-ad74-c21afeb1e245 None admin] RBAC: Authorizing `identity:create_grant(project_id=0984058b3d114dee94ef957c8703fd0a, user_id=0452b4d415d54cb5a7206cef55d400d5, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:46.066318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:46.068084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772cbfe4-b66b-4c8b-ad74-c21afeb1e245 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:46.088613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 62/131] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:24:45 2022] PUT /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a/users/0452b4d415d54cb5a7206cef55d400d5/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:24:46.089835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cbfe4-b66b-4c8b-ad74-c21afeb1e245 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:46.121573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:46.183825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3507a96d-275a-49eb-9592-125d600a7582 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:46.221604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772cbfe4-b66b-4c8b-ad74-c21afeb1e245 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:46.225214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322beb8-babf-4f2d-93d6-97be3dedeeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:46.226265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322beb8-babf-4f2d-93d6-97be3dedeeff None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.226744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322beb8-babf-4f2d-93d6-97be3dedeeff None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.227204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322beb8-babf-4f2d-93d6-97be3dedeeff None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.228688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322beb8-babf-4f2d-93d6-97be3dedeeff None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:46.230462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322beb8-babf-4f2d-93d6-97be3dedeeff None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:46.232853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 70/132] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:46 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:46.234127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322beb8-babf-4f2d-93d6-97be3dedeeff None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:46.265233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:46.266019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.266407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.266813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.267628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] RBAC: Adding query filter params (role.id=1dc9ff2bc5034e32b66a5d9d3e388009, scope.project.id=0984058b3d114dee94ef957c8703fd0a, user.id=1ec7215957414d6bbe46c2fb6313e7c8) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:46.268020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:46.270977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:46.277897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 63/133] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:46 2022] GET /identity/v3/role_assignments?user.id=1ec7215957414d6bbe46c2fb6313e7c8&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=1dc9ff2bc5034e32b66a5d9d3e388009 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:46.278666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:46.334636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:46.377594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322beb8-babf-4f2d-93d6-97be3dedeeff None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:46.465399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d48a79-1046-436d-86af-c038e9a3ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:46.466085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48a79-1046-436d-86af-c038e9a3ab1e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.466376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48a79-1046-436d-86af-c038e9a3ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.466781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d48a79-1046-436d-86af-c038e9a3ab1e None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.473142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d48a79-1046-436d-86af-c038e9a3ab1e None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:46.474678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d48a79-1046-436d-86af-c038e9a3ab1e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:46.482062 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 71/134] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:46 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:46.486217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d48a79-1046-436d-86af-c038e9a3ab1e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:46.493761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:46.516291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f7638-7965-429b-9167-2d718d1369cc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:46.620208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50022c2b-3bb6-4c69-8aef-32c6024898a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:46.621222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50022c2b-3bb6-4c69-8aef-32c6024898a7 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.621736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50022c2b-3bb6-4c69-8aef-32c6024898a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.627714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50022c2b-3bb6-4c69-8aef-32c6024898a7 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a/users/ae1358b70c5d4155a112c19691b493c9/roles/04b06cf4afbb4f3fa6cb347496ae7a81` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.634174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50022c2b-3bb6-4c69-8aef-32c6024898a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0984058b3d114dee94ef957c8703fd0a, user_id=ae1358b70c5d4155a112c19691b493c9, role_id=04b06cf4afbb4f3fa6cb347496ae7a81)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:46.641546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50022c2b-3bb6-4c69-8aef-32c6024898a7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:46.689442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 64/135] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:24:46 2022] PUT /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a/users/ae1358b70c5d4155a112c19691b493c9/roles/04b06cf4afbb4f3fa6cb347496ae7a81 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:24:46.691745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507a7a-4ca9-4d39-9f14-e5f0a3f774e6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.692247 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507a7a-4ca9-4d39-9f14-e5f0a3f774e6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.692745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3507a7a-4ca9-4d39-9f14-e5f0a3f774e6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.695663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 65/136] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:46.704532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1741-8d52-4a24-acaa-053228c6d697 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.704997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1741-8d52-4a24-acaa-053228c6d697 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.705467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f1741-8d52-4a24-acaa-053228c6d697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.719298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d48a79-1046-436d-86af-c038e9a3ab1e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:46.763957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-822f1741-8d52-4a24-acaa-053228c6d697 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:46.766002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-822f1741-8d52-4a24-acaa-053228c6d697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:46.867934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac63c1-53e2-401d-96a5-1f103eefa114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:46.868973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac63c1-53e2-401d-96a5-1f103eefa114 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.869470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac63c1-53e2-401d-96a5-1f103eefa114 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.869985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac63c1-53e2-401d-96a5-1f103eefa114 None admin] PATH_INFO: `/v3/projects/a04e5619c693481d9f69744c3718da18` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.875004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac63c1-53e2-401d-96a5-1f103eefa114 None admin] RBAC: Authorizing `identity:get_project(project_id=a04e5619c693481d9f69744c3718da18)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:46.877464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ac63c1-53e2-401d-96a5-1f103eefa114 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:46.880445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 72/137] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:46 2022] GET /identity/v3/projects/a04e5619c693481d9f69744c3718da18 => generated 312 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:46.886813 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac63c1-53e2-401d-96a5-1f103eefa114 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:46.921406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:46.942214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 66/138] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:46.944566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38db8-d983-471e-a60a-d2a207d6c15a None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.945127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38db8-d983-471e-a60a-d2a207d6c15a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.945629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f38db8-d983-471e-a60a-d2a207d6c15a None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:46.949391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 67/139] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:46.956229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9f0c-4cbd-4f02-9343-03e89eda1821 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:46.956734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9f0c-4cbd-4f02-9343-03e89eda1821 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:46.957181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a9f0c-4cbd-4f02-9343-03e89eda1821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:47.016455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-862a9f0c-4cbd-4f02-9343-03e89eda1821 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:47.024147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-862a9f0c-4cbd-4f02-9343-03e89eda1821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:47.153833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 68/140] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:47.165894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac63c1-53e2-401d-96a5-1f103eefa114 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:47.212857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38800c4-60b2-4155-8f9d-98ca3adac68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:47.213579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38800c4-60b2-4155-8f9d-98ca3adac68b None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:47.213867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38800c4-60b2-4155-8f9d-98ca3adac68b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:47.214166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38800c4-60b2-4155-8f9d-98ca3adac68b None admin] PATH_INFO: `/v3/projects/a04e5619c693481d9f69744c3718da18/users/ae1358b70c5d4155a112c19691b493c9/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:47.216936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38800c4-60b2-4155-8f9d-98ca3adac68b None admin] RBAC: Authorizing `identity:create_grant(project_id=a04e5619c693481d9f69744c3718da18, user_id=ae1358b70c5d4155a112c19691b493c9, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:47.218423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38800c4-60b2-4155-8f9d-98ca3adac68b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:47.248892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 73/141] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:24:46 2022] PUT /identity/v3/projects/a04e5619c693481d9f69744c3718da18/users/ae1358b70c5d4155a112c19691b493c9/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:24:47.426597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9f0c-4cbd-4f02-9343-03e89eda1821 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:47.438520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:47.552142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a9f0c-4cbd-4f02-9343-03e89eda1821 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:47.604346 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965486-5b5f-4a63-a7ed-ff2e6f4e695c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:47.604992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965486-5b5f-4a63-a7ed-ff2e6f4e695c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:47.605279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965486-5b5f-4a63-a7ed-ff2e6f4e695c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:47.605552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d965486-5b5f-4a63-a7ed-ff2e6f4e695c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:47.621673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d965486-5b5f-4a63-a7ed-ff2e6f4e695c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-1d965486-5b5f-4a63-a7ed-ff2e6f4e695c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:47.626577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:47.627455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:47.628327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 69/142] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:47.634082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38800c4-60b2-4155-8f9d-98ca3adac68b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:47.677832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965486-5b5f-4a63-a7ed-ff2e6f4e695c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:47.724855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:47.794310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:47.794671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38800c4-60b2-4155-8f9d-98ca3adac68b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:47.860193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d965486-5b5f-4a63-a7ed-ff2e6f4e695c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:47.867673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:47.868307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:47.868593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:47.868876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:47.869567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:47.869897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:47.871321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:47.885724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 74/143] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:47.891897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:47.937359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a395ec-6c1b-4ec4-8039-f9f4dcc9e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:47.937956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a395ec-6c1b-4ec4-8039-f9f4dcc9e278 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:47.938247 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a395ec-6c1b-4ec4-8039-f9f4dcc9e278 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:47.938525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a395ec-6c1b-4ec4-8039-f9f4dcc9e278 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:47.942568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a395ec-6c1b-4ec4-8039-f9f4dcc9e278 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:47.944144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a395ec-6c1b-4ec4-8039-f9f4dcc9e278 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:47.945841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 70/144] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:47.951348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a395ec-6c1b-4ec4-8039-f9f4dcc9e278 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:48.017330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc1ad52-2df1-4f78-be70-a403a7a23c58 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:48.056868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a3f1-4fc9-42aa-8cf5-494ac50b66ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:48.057509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a3f1-4fc9-42aa-8cf5-494ac50b66ba None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:48.057798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a3f1-4fc9-42aa-8cf5-494ac50b66ba None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:48.058109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5a3f1-4fc9-42aa-8cf5-494ac50b66ba None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:48.061908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5a3f1-4fc9-42aa-8cf5-494ac50b66ba None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:48.061908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5a3f1-4fc9-42aa-8cf5-494ac50b66ba None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:48.062516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 75/145] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:47 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:48.062864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:48.071066 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a3f1-4fc9-42aa-8cf5-494ac50b66ba None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:48.190108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a395ec-6c1b-4ec4-8039-f9f4dcc9e278 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:48.226111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879516e-a77c-42c0-87bb-d7463c603808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:48.226741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879516e-a77c-42c0-87bb-d7463c603808 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:48.227034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879516e-a77c-42c0-87bb-d7463c603808 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:48.227319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4879516e-a77c-42c0-87bb-d7463c603808 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:48.227983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879516e-a77c-42c0-87bb-d7463c603808 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:48.229519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4879516e-a77c-42c0-87bb-d7463c603808 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:48.246373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:48.252041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5a3f1-4fc9-42aa-8cf5-494ac50b66ba None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:48.260431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 71/146] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:24:47 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:24:48.313954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4709a-31e2-4af9-91d6-ba2e3653749b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:48.314932 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4709a-31e2-4af9-91d6-ba2e3653749b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:48.315556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4709a-31e2-4af9-91d6-ba2e3653749b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:48.316205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4709a-31e2-4af9-91d6-ba2e3653749b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:48.385150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:48.398302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4709a-31e2-4af9-91d6-ba2e3653749b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:48.400240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4709a-31e2-4af9-91d6-ba2e3653749b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:48.522976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 76/147] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:48.531284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879516e-a77c-42c0-87bb-d7463c603808 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:48.694134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4879516e-a77c-42c0-87bb-d7463c603808 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:48.728218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7665b053-12e0-40de-94d3-1dd2666f8509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:48.728858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665b053-12e0-40de-94d3-1dd2666f8509 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:48.729142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665b053-12e0-40de-94d3-1dd2666f8509 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:48.729416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7665b053-12e0-40de-94d3-1dd2666f8509 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:48.730576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665b053-12e0-40de-94d3-1dd2666f8509 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:48.732170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7665b053-12e0-40de-94d3-1dd2666f8509 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:48.734139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 72/148] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:48 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:48.740445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4709a-31e2-4af9-91d6-ba2e3653749b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:48.873713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:48.885670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4709a-31e2-4af9-91d6-ba2e3653749b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:48.935717 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549a2e8-d434-4e95-a91e-b461b0f118cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:48.936342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a2e8-d434-4e95-a91e-b461b0f118cc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:48.936632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a2e8-d434-4e95-a91e-b461b0f118cc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:48.936914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549a2e8-d434-4e95-a91e-b461b0f118cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:48.937660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549a2e8-d434-4e95-a91e-b461b0f118cc None admin] RBAC: Adding query filter params (role.id=e104332d9de24bed8d32257cab931633, scope.project.id=0984058b3d114dee94ef957c8703fd0a, user.id=ae1358b70c5d4155a112c19691b493c9) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:48.938002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549a2e8-d434-4e95-a91e-b461b0f118cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:48.939577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549a2e8-d434-4e95-a91e-b461b0f118cc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:48.950163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 77/149] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:48 2022] GET /identity/v3/role_assignments?user.id=ae1358b70c5d4155a112c19691b493c9&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=e104332d9de24bed8d32257cab931633 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:48.958293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7373-aa73-427a-874e-37e1560e4f8c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:48.958917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7373-aa73-427a-874e-37e1560e4f8c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:48.959386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7373-aa73-427a-874e-37e1560e4f8c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:48.961002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 73/150] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:48.967101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32f6c-e49f-4122-8483-b8de8cacda27 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:48.967397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32f6c-e49f-4122-8483-b8de8cacda27 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:48.967688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa32f6c-e49f-4122-8483-b8de8cacda27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:48.995195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1fa32f6c-e49f-4122-8483-b8de8cacda27 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:48.996476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1fa32f6c-e49f-4122-8483-b8de8cacda27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:49.094322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 78/151] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:49.227856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fe76e-d111-4e72-a2ed-c205f15ec54e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:49.228491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fe76e-d111-4e72-a2ed-c205f15ec54e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:49.228958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145fe76e-d111-4e72-a2ed-c205f15ec54e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:49.230580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 74/152] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:49.235874 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296209b-2f64-4225-848c-df1962b6addf None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:49.236206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296209b-2f64-4225-848c-df1962b6addf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:49.236499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296209b-2f64-4225-848c-df1962b6addf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:49.257929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9296209b-2f64-4225-848c-df1962b6addf None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:49.259155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9296209b-2f64-4225-848c-df1962b6addf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:49.343611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 79/153] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:49.459984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fe76e-d111-4e72-a2ed-c205f15ec54e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:49.534899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:49.593556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145fe76e-d111-4e72-a2ed-c205f15ec54e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:49.635187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dc7b9-94bb-4316-82c2-4292f4622d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:49.637562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dc7b9-94bb-4316-82c2-4292f4622d00 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:49.638083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dc7b9-94bb-4316-82c2-4292f4622d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:49.638546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6dc7b9-94bb-4316-82c2-4292f4622d00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:49.652777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6dc7b9-94bb-4316-82c2-4292f4622d00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-bc6dc7b9-94bb-4316-82c2-4292f4622d00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:49.659730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:49.660670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:49.661399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:49.663663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 75/154] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:24:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:49.669416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296209b-2f64-4225-848c-df1962b6addf None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:49.693752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:49.770051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dc7b9-94bb-4316-82c2-4292f4622d00 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:49.788790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296209b-2f64-4225-848c-df1962b6addf None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:49.827627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:49.828258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:49.828545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:49.828832 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:49.829511 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:49.829826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:49.831329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:49.841028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 80/155] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:49.847312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:49.948462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:49.951825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6dc7b9-94bb-4316-82c2-4292f4622d00 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:49.968280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa729f69-183a-4f7d-9f2b-67e20cb6b5e0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:49.984818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:50.012661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfce5fe-0835-4531-862e-8b69e75b73fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:50.013662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfce5fe-0835-4531-862e-8b69e75b73fb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.014166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfce5fe-0835-4531-862e-8b69e75b73fb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.014787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfce5fe-0835-4531-862e-8b69e75b73fb None admin] PATH_INFO: `/v3/users/0452b4d415d54cb5a7206cef55d400d5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.016317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfce5fe-0835-4531-862e-8b69e75b73fb None admin] RBAC: Authorizing `identity:get_user(user_id=0452b4d415d54cb5a7206cef55d400d5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:50.018012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfce5fe-0835-4531-862e-8b69e75b73fb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:50.022448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ecea-9f4f-4a79-88f4-16ba6d81b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:50.023172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ecea-9f4f-4a79-88f4-16ba6d81b50b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.023458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ecea-9f4f-4a79-88f4-16ba6d81b50b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.023733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467ecea-9f4f-4a79-88f4-16ba6d81b50b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.024106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 81/156] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:49 2022] GET /identity/v3/users/0452b4d415d54cb5a7206cef55d400d5 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:50.030751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfce5fe-0835-4531-862e-8b69e75b73fb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:50.041857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467ecea-9f4f-4a79-88f4-16ba6d81b50b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8467ecea-9f4f-4a79-88f4-16ba6d81b50b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:50.046731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:50.047796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:50.048555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 76/157] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:24:50.072350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ecea-9f4f-4a79-88f4-16ba6d81b50b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:50.148520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfce5fe-0835-4531-862e-8b69e75b73fb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:50.185035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5adec-0936-43fc-ab9f-2e31bee07533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:50.186050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5adec-0936-43fc-ab9f-2e31bee07533 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.186555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5adec-0936-43fc-ab9f-2e31bee07533 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.187025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5adec-0936-43fc-ab9f-2e31bee07533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.208072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:50.253485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467ecea-9f4f-4a79-88f4-16ba6d81b50b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:50.262131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5adec-0936-43fc-ab9f-2e31bee07533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:50.264065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5adec-0936-43fc-ab9f-2e31bee07533 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:50.303907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df644784-6986-45ea-9e83-9d6ec64589ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:50.304443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644784-6986-45ea-9e83-9d6ec64589ab None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.304727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644784-6986-45ea-9e83-9d6ec64589ab None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.305000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df644784-6986-45ea-9e83-9d6ec64589ab None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.305675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644784-6986-45ea-9e83-9d6ec64589ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:50.306008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644784-6986-45ea-9e83-9d6ec64589ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:50.307772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df644784-6986-45ea-9e83-9d6ec64589ab None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:50.317055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 77/158] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:50.321914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432f12-56e1-4efa-bc87-ead78843f360 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.321914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432f12-56e1-4efa-bc87-ead78843f360 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.321914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c432f12-56e1-4efa-bc87-ead78843f360 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.321914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 78/159] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:50.323924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432f12-56e1-4efa-bc87-ead78843f360 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:50.379456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:50.407867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 82/160] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:24:50.409847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aa0e4-170d-4796-bd34-87ee25e746cc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.410541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aa0e4-170d-4796-bd34-87ee25e746cc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.411004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209aa0e4-170d-4796-bd34-87ee25e746cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.434903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-209aa0e4-170d-4796-bd34-87ee25e746cc None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:50.436105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-209aa0e4-170d-4796-bd34-87ee25e746cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:50.456143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c432f12-56e1-4efa-bc87-ead78843f360 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:50.488312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:50.496409 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed099e5-d5a2-47f6-9574-eef525f2349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:50.497841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed099e5-d5a2-47f6-9574-eef525f2349c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.498373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed099e5-d5a2-47f6-9574-eef525f2349c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.498853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed099e5-d5a2-47f6-9574-eef525f2349c None admin] PATH_INFO: `/v3/users/1ec7215957414d6bbe46c2fb6313e7c8` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.500306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed099e5-d5a2-47f6-9574-eef525f2349c None admin] RBAC: Authorizing `identity:get_user(user_id=1ec7215957414d6bbe46c2fb6313e7c8)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:50.502064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed099e5-d5a2-47f6-9574-eef525f2349c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:50.505179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 79/161] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:50 2022] GET /identity/v3/users/1ec7215957414d6bbe46c2fb6313e7c8 => generated 289 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:50.510177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed099e5-d5a2-47f6-9574-eef525f2349c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:50.512605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 83/162] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:50.523060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aa0e4-170d-4796-bd34-87ee25e746cc None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:50.620973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed099e5-d5a2-47f6-9574-eef525f2349c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:50.632779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:50.658216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec65e1-ccce-4ada-856b-8d43ef8f165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:50.659872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec65e1-ccce-4ada-856b-8d43ef8f165f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.660428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec65e1-ccce-4ada-856b-8d43ef8f165f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.660956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec65e1-ccce-4ada-856b-8d43ef8f165f None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.662660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec65e1-ccce-4ada-856b-8d43ef8f165f None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:50.664379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec65e1-ccce-4ada-856b-8d43ef8f165f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:50.666458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 80/163] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:50 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:50.667959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb5a9-4561-44e4-91d9-60bc295b0075 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.668464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb5a9-4561-44e4-91d9-60bc295b0075 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.669001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25fb5a9-4561-44e4-91d9-60bc295b0075 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.670438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 81/164] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:50.672263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb5a9-4561-44e4-91d9-60bc295b0075 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:50.685806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209aa0e4-170d-4796-bd34-87ee25e746cc None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:50.740125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280d293-0e99-4efd-b299-cfaba60e0097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:50.740833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280d293-0e99-4efd-b299-cfaba60e0097 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.741112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280d293-0e99-4efd-b299-cfaba60e0097 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.741436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280d293-0e99-4efd-b299-cfaba60e0097 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.742674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280d293-0e99-4efd-b299-cfaba60e0097 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:50.744858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6280d293-0e99-4efd-b299-cfaba60e0097 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:50.748094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 84/165] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:50 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:50.755965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7570eb-a75e-4526-ab01-6a87d94a7ff1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.757167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7570eb-a75e-4526-ab01-6a87d94a7ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.757448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7570eb-a75e-4526-ab01-6a87d94a7ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.796978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1a7570eb-a75e-4526-ab01-6a87d94a7ff1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:50.800767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1a7570eb-a75e-4526-ab01-6a87d94a7ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:50.865995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25fb5a9-4561-44e4-91d9-60bc295b0075 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:50.895971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:50.904863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:50.905770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:50.906308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:50.906789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:50.907723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=0984058b3d114dee94ef957c8703fd0a, user.id=0452b4d415d54cb5a7206cef55d400d5) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:50.908230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:50.910150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:50.917802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 82/166] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:50 2022] GET /identity/v3/role_assignments?user.id=0452b4d415d54cb5a7206cef55d400d5&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=f21c9b5697b747d39bf8f104797da245 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:50.918982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:50.943343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 85/167] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:50.997908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:51.115371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff6716a-a873-466a-afec-9c7bdad228e0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:51.135324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7570eb-a75e-4526-ab01-6a87d94a7ff1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:51.176440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f3d8e-6195-45a6-9ce0-7599223b1f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:51.177176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f3d8e-6195-45a6-9ce0-7599223b1f33 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:51.177460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f3d8e-6195-45a6-9ce0-7599223b1f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:51.177734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f3d8e-6195-45a6-9ce0-7599223b1f33 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a/users/1ec7215957414d6bbe46c2fb6313e7c8/roles/1dc9ff2bc5034e32b66a5d9d3e388009` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:51.183133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f3d8e-6195-45a6-9ce0-7599223b1f33 None admin] RBAC: Authorizing `identity:create_grant(project_id=0984058b3d114dee94ef957c8703fd0a, user_id=1ec7215957414d6bbe46c2fb6313e7c8, role_id=1dc9ff2bc5034e32b66a5d9d3e388009)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:51.184573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f3d8e-6195-45a6-9ce0-7599223b1f33 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:51.214240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 83/168] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:24:50 2022] PUT /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a/users/1ec7215957414d6bbe46c2fb6313e7c8/roles/1dc9ff2bc5034e32b66a5d9d3e388009 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:24:51.296478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7570eb-a75e-4526-ab01-6a87d94a7ff1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:51.347073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ffd6e-e1fd-473e-a70f-040c11a5cba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:51.348127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ffd6e-e1fd-473e-a70f-040c11a5cba7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:51.348622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ffd6e-e1fd-473e-a70f-040c11a5cba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:51.349103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ffd6e-e1fd-473e-a70f-040c11a5cba7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:51.362876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f3d8e-6195-45a6-9ce0-7599223b1f33 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:51.375273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ffd6e-e1fd-473e-a70f-040c11a5cba7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-646ffd6e-e1fd-473e-a70f-040c11a5cba7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:51.382751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:51.383673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:51.384489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 86/169] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:24:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:24:51.391450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ffd6e-e1fd-473e-a70f-040c11a5cba7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:51.494254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:51.600154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f3d8e-6195-45a6-9ce0-7599223b1f33 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:51.602077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:51.604530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ffd6e-e1fd-473e-a70f-040c11a5cba7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:51.647756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:51.648917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:51.649453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:51.649980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:51.650881 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:51.651391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:51.653244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:51.663897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 87/170] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:24:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:51.671175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:51.684171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d6f38-0f46-4649-910c-ccf96db88cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:51.684833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d6f38-0f46-4649-910c-ccf96db88cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:51.685117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d6f38-0f46-4649-910c-ccf96db88cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:51.685392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4d6f38-0f46-4649-910c-ccf96db88cb1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:51.718831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4d6f38-0f46-4649-910c-ccf96db88cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8b4d6f38-0f46-4649-910c-ccf96db88cb1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:51.724975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:51.725838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:51.726716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 84/171] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:24:51.735100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d6f38-0f46-4649-910c-ccf96db88cb1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:51.858261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:51.863392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcad105-9833-4ca6-a404-6fe5f32264ba None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:51.959034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643d3eb-035c-4732-87ae-c801d4494bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:51.959427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d3eb-035c-4732-87ae-c801d4494bcc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:51.959609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d3eb-035c-4732-87ae-c801d4494bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:51.959901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5643d3eb-035c-4732-87ae-c801d4494bcc None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:51.961057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643d3eb-035c-4732-87ae-c801d4494bcc None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:51.962776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5643d3eb-035c-4732-87ae-c801d4494bcc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:51.964680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 88/172] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:51 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:51.974317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643d3eb-035c-4732-87ae-c801d4494bcc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:52.001718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4d6f38-0f46-4649-910c-ccf96db88cb1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:52.080660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:52.086137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.086656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.087177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.088073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:52.088603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:52.090309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:52.105282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 85/173] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:52.110776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:52.151067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:52.161848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5643d3eb-035c-4732-87ae-c801d4494bcc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:52.231615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a852f-1d63-40e7-bb62-4628fc533c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:52.232159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a852f-1d63-40e7-bb62-4628fc533c40 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.232446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a852f-1d63-40e7-bb62-4628fc533c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.232722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a852f-1d63-40e7-bb62-4628fc533c40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.247375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dc44f2-e6c3-4113-b6f0-3bda5c44dbac None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:52.287836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0898ec-8e3b-454e-a572-d2aa174d74fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:52.288873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0898ec-8e3b-454e-a572-d2aa174d74fc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.289427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0898ec-8e3b-454e-a572-d2aa174d74fc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.289945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0898ec-8e3b-454e-a572-d2aa174d74fc None admin] PATH_INFO: `/v3/users/ae1358b70c5d4155a112c19691b493c9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.291584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:52.293063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0898ec-8e3b-454e-a572-d2aa174d74fc None admin] RBAC: Authorizing `identity:get_user(user_id=ae1358b70c5d4155a112c19691b493c9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:52.295807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0898ec-8e3b-454e-a572-d2aa174d74fc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:52.298104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 86/174] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:52 2022] GET /identity/v3/users/ae1358b70c5d4155a112c19691b493c9 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:52.303569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0898ec-8e3b-454e-a572-d2aa174d74fc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:52.355069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a852f-1d63-40e7-bb62-4628fc533c40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:52.356569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a852f-1d63-40e7-bb62-4628fc533c40 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:52.451517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:52.462503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0898ec-8e3b-454e-a572-d2aa174d74fc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:52.502641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658b3647-c0b7-47a4-bc5f-bbf1262118a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:52.503963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3647-c0b7-47a4-bc5f-bbf1262118a0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.504565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3647-c0b7-47a4-bc5f-bbf1262118a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.505068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3647-c0b7-47a4-bc5f-bbf1262118a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.511686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 89/175] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:24:52.513022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ab08-430c-4b77-9c7f-281ca2ee6e05 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.513310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ab08-430c-4b77-9c7f-281ca2ee6e05 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.513587 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c3ab08-430c-4b77-9c7f-281ca2ee6e05 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.514863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 90/176] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:52.524880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3ab08-430c-4b77-9c7f-281ca2ee6e05 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:52.587331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3647-c0b7-47a4-bc5f-bbf1262118a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:52.589169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658b3647-c0b7-47a4-bc5f-bbf1262118a0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:52.692332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:52.703874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 87/177] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:52.705607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932adf2-006a-47a8-9450-07256f589e8c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.706832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932adf2-006a-47a8-9450-07256f589e8c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.707604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932adf2-006a-47a8-9450-07256f589e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.727387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b932adf2-006a-47a8-9450-07256f589e8c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:52.728957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b932adf2-006a-47a8-9450-07256f589e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:52.733564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:52.806850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 88/178] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:52.808182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932adf2-006a-47a8-9450-07256f589e8c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:52.837007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c3ab08-430c-4b77-9c7f-281ca2ee6e05 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:52.920817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932adf2-006a-47a8-9450-07256f589e8c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:52.935164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d9e4-9834-4aa6-9162-8740b6f95cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:52.935821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d9e4-9834-4aa6-9162-8740b6f95cfd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.936110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d9e4-9834-4aa6-9162-8740b6f95cfd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.936387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847d9e4-9834-4aa6-9162-8740b6f95cfd None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.942639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d9e4-9834-4aa6-9162-8740b6f95cfd None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:52.944124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9847d9e4-9834-4aa6-9162-8740b6f95cfd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:52.945824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 91/179] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:52 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:52.950772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:52.951792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d9e4-9834-4aa6-9162-8740b6f95cfd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:52.965202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f4d43-af51-43bb-a400-a943b6b2be4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:52.966288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4d43-af51-43bb-a400-a943b6b2be4c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.966778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4d43-af51-43bb-a400-a943b6b2be4c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.967256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f4d43-af51-43bb-a400-a943b6b2be4c None admin] PATH_INFO: `/v3/projects/a04e5619c693481d9f69744c3718da18` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.968631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f4d43-af51-43bb-a400-a943b6b2be4c None admin] RBAC: Authorizing `identity:get_project(project_id=a04e5619c693481d9f69744c3718da18)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:52.970351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f4d43-af51-43bb-a400-a943b6b2be4c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:52.973273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 89/180] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:52 2022] GET /identity/v3/projects/a04e5619c693481d9f69744c3718da18 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:52.974733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd81f-95d8-41a3-91c7-c4e8dd334db1 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:52.975225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd81f-95d8-41a3-91c7-c4e8dd334db1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:52.975713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bdd81f-95d8-41a3-91c7-c4e8dd334db1 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:52.977149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 90/181] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:52.982800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd81f-95d8-41a3-91c7-c4e8dd334db1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:53.087667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847d9e4-9834-4aa6-9162-8740b6f95cfd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:53.125331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f4f9a-ac7a-4d81-9e96-2fe7d02e416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:53.126361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f4f9a-ac7a-4d81-9e96-2fe7d02e416a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.126945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f4f9a-ac7a-4d81-9e96-2fe7d02e416a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.127489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f4f9a-ac7a-4d81-9e96-2fe7d02e416a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.129209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bdd81f-95d8-41a3-91c7-c4e8dd334db1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:53.129852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f4f9a-ac7a-4d81-9e96-2fe7d02e416a None admin] RBAC: Adding query filter params (role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=0984058b3d114dee94ef957c8703fd0a, user.id=ae1358b70c5d4155a112c19691b493c9) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:53.130390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f4f9a-ac7a-4d81-9e96-2fe7d02e416a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:53.132088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f4f9a-ac7a-4d81-9e96-2fe7d02e416a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:53.135800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:53.140378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 92/182] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:52 2022] GET /identity/v3/role_assignments?user.id=ae1358b70c5d4155a112c19691b493c9&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:53.141834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8670da-f459-46d0-93c5-5b7825ce11c1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.142383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8670da-f459-46d0-93c5-5b7825ce11c1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.142884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8670da-f459-46d0-93c5-5b7825ce11c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.174014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-eb8670da-f459-46d0-93c5-5b7825ce11c1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:53.176816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eb8670da-f459-46d0-93c5-5b7825ce11c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:53.202209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bcfd6b-ed29-4676-962d-52b677e05c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:53.203230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfd6b-ed29-4676-962d-52b677e05c6d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.203743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfd6b-ed29-4676-962d-52b677e05c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.204251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bcfd6b-ed29-4676-962d-52b677e05c6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.205202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcfd6b-ed29-4676-962d-52b677e05c6d None admin] RBAC: Adding query filter params (role.id=e104332d9de24bed8d32257cab931633, scope.project.id=a04e5619c693481d9f69744c3718da18, user.id=ae1358b70c5d4155a112c19691b493c9) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:53.205730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcfd6b-ed29-4676-962d-52b677e05c6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:53.208408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bcfd6b-ed29-4676-962d-52b677e05c6d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:53.215204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 91/183] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:52 2022] GET /identity/v3/role_assignments?user.id=ae1358b70c5d4155a112c19691b493c9&scope.project.id=a04e5619c693481d9f69744c3718da18&role.id=e104332d9de24bed8d32257cab931633 => generated 608 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:53.216951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a50f-4326-4a21-b4bd-816917146719 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.217521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a50f-4326-4a21-b4bd-816917146719 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.218975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c2a50f-4326-4a21-b4bd-816917146719 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.220852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 92/184] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:53.222108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a50f-4326-4a21-b4bd-816917146719 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:53.306278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 93/185] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:53.308132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d55d-8632-47e2-ac5a-22301161dd39 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.309514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d55d-8632-47e2-ac5a-22301161dd39 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.310177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d55d-8632-47e2-ac5a-22301161dd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.337870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:53.355999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-40f5d55d-8632-47e2-ac5a-22301161dd39 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:53.357696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-40f5d55d-8632-47e2-ac5a-22301161dd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:53.438540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c2a50f-4326-4a21-b4bd-816917146719 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:53.481775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62591a-469f-472c-bb57-d1b1b8e65fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:53.482864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62591a-469f-472c-bb57-d1b1b8e65fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.483366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62591a-469f-472c-bb57-d1b1b8e65fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.483576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 94/186] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:53.483975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62591a-469f-472c-bb57-d1b1b8e65fd0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.496876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62591a-469f-472c-bb57-d1b1b8e65fd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-6d62591a-469f-472c-bb57-d1b1b8e65fd0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:53.502177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:53.503520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:53.504714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:53.506721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 93/187] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:53.513313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5d55d-8632-47e2-ac5a-22301161dd39 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:53.579515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:53.630728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5d55d-8632-47e2-ac5a-22301161dd39 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:53.667616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:53.668295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.668580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.668856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.669538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:53.669847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:53.671830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62591a-469f-472c-bb57-d1b1b8e65fd0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:53.674564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:53.683767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 95/188] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:53.692457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:53.809224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62591a-469f-472c-bb57-d1b1b8e65fd0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:53.820316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d2bf1-6de9-415a-b7b5-9168ded19043 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:53.825377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:53.848724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c70f-e43c-4220-b142-89526f6cdfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:53.849362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c70f-e43c-4220-b142-89526f6cdfbe None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.849638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c70f-e43c-4220-b142-89526f6cdfbe None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.849736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:53.849977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394c70f-e43c-4220-b142-89526f6cdfbe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.860867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394c70f-e43c-4220-b142-89526f6cdfbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:53.863883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2547c-5530-4aa2-b827-0efa924e8ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:53.864522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2547c-5530-4aa2-b827-0efa924e8ee5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:53.864808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2547c-5530-4aa2-b827-0efa924e8ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:53.865086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2547c-5530-4aa2-b827-0efa924e8ee5 None admin] PATH_INFO: `/v3/users/9ebbfe4256394e0899a882172e982b2a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a394c70f-e43c-4220-b142-89526f6cdfbe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:53.866459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:53.867324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:53.868878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 94/189] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:24:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:24:53.870684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c70f-e43c-4220-b142-89526f6cdfbe None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:53.882102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2547c-5530-4aa2-b827-0efa924e8ee5 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebbfe4256394e0899a882172e982b2a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:53.883533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2547c-5530-4aa2-b827-0efa924e8ee5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:53.885201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 96/190] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:53 2022] GET /identity/v3/users/9ebbfe4256394e0899a882172e982b2a => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:53.886054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2547c-5530-4aa2-b827-0efa924e8ee5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:53.977035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394c70f-e43c-4220-b142-89526f6cdfbe None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:53.992069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2547c-5530-4aa2-b827-0efa924e8ee5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:54.010823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64308ff-5cfe-4b6d-99fb-901763a7b1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:54.011452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64308ff-5cfe-4b6d-99fb-901763a7b1fb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.011738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64308ff-5cfe-4b6d-99fb-901763a7b1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.012018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64308ff-5cfe-4b6d-99fb-901763a7b1fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.013121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64308ff-5cfe-4b6d-99fb-901763a7b1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:54.014625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64308ff-5cfe-4b6d-99fb-901763a7b1fb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:54.016343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 95/191] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:54.017031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64308ff-5cfe-4b6d-99fb-901763a7b1fb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:54.027817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d054dc-3d86-4563-9a19-968841661cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:54.028434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d054dc-3d86-4563-9a19-968841661cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.028723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d054dc-3d86-4563-9a19-968841661cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.029000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d054dc-3d86-4563-9a19-968841661cb6 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.029666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d054dc-3d86-4563-9a19-968841661cb6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:54.030000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d054dc-3d86-4563-9a19-968841661cb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:54.031390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d054dc-3d86-4563-9a19-968841661cb6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:54.040354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 97/192] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:24:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:54.040354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958aeda-211e-4f0b-928d-10c39c9e65d9 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.040354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958aeda-211e-4f0b-928d-10c39c9e65d9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.040354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b958aeda-211e-4f0b-928d-10c39c9e65d9 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.040354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 98/193] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:54.046668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958aeda-211e-4f0b-928d-10c39c9e65d9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:54.062523 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:54.093751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:54.121374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64308ff-5cfe-4b6d-99fb-901763a7b1fb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:54.151751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b958aeda-211e-4f0b-928d-10c39c9e65d9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:54.155147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e5d79-9224-4603-b991-a04288ca9e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:54.155754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5d79-9224-4603-b991-a04288ca9e7e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.156036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5d79-9224-4603-b991-a04288ca9e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.156310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5d79-9224-4603-b991-a04288ca9e7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.185363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ae06-a699-4979-996f-a5c05faff74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:54.186044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ae06-a699-4979-996f-a5c05faff74f None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.186335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ae06-a699-4979-996f-a5c05faff74f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.186612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ae06-a699-4979-996f-a5c05faff74f None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.187300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3ae06-a699-4979-996f-a5c05faff74f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:54.188729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3ae06-a699-4979-996f-a5c05faff74f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:54.209172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 99/194] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:24:54 2022] POST /identity/v3/users => generated 297 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:54.209823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ae06-a699-4979-996f-a5c05faff74f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:54.231790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e5d79-9224-4603-b991-a04288ca9e7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:54.233344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2e5d79-9224-4603-b991-a04288ca9e7e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:54.280693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:54.325977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:54.331582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ae06-a699-4979-996f-a5c05faff74f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:54.349427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 96/195] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:54.349427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062539-c6fa-4ba6-a020-d92b67080300 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.349427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062539-c6fa-4ba6-a020-d92b67080300 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.349427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05062539-c6fa-4ba6-a020-d92b67080300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.370710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-05062539-c6fa-4ba6-a020-d92b67080300 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:54.371905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-05062539-c6fa-4ba6-a020-d92b67080300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:54.384429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49de27-669a-4152-a228-d651a7ce5713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:54.385075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49de27-669a-4152-a228-d651a7ce5713 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.385357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49de27-669a-4152-a228-d651a7ce5713 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.385629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49de27-669a-4152-a228-d651a7ce5713 None admin] PATH_INFO: `/v3/users/9ebbfe4256394e0899a882172e982b2a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.386852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49de27-669a-4152-a228-d651a7ce5713 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebbfe4256394e0899a882172e982b2a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:54.388312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc49de27-669a-4152-a228-d651a7ce5713 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:54.390051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 100/196] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:54 2022] GET /identity/v3/users/9ebbfe4256394e0899a882172e982b2a => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:54.390875 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49de27-669a-4152-a228-d651a7ce5713 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:54.463358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 97/197] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:54.463358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062539-c6fa-4ba6-a020-d92b67080300 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:54.520996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49de27-669a-4152-a228-d651a7ce5713 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:54.550741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:54.558459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad2db-eec6-4629-a7cb-e9e0dc13d773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:54.559154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad2db-eec6-4629-a7cb-e9e0dc13d773 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.559435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad2db-eec6-4629-a7cb-e9e0dc13d773 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.559710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ad2db-eec6-4629-a7cb-e9e0dc13d773 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.563342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ad2db-eec6-4629-a7cb-e9e0dc13d773 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:54.566504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ad2db-eec6-4629-a7cb-e9e0dc13d773 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:54.568466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 101/198] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:54 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:54.574205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad2db-eec6-4629-a7cb-e9e0dc13d773 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:54.587060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05062539-c6fa-4ba6-a020-d92b67080300 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:54.614317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:54.627570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4dff-2fda-4b08-8b1f-b528ac7976ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:54.629394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4dff-2fda-4b08-8b1f-b528ac7976ed None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.629914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4dff-2fda-4b08-8b1f-b528ac7976ed None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.630418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d4dff-2fda-4b08-8b1f-b528ac7976ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.689517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ad2db-eec6-4629-a7cb-e9e0dc13d773 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:54.705219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d4dff-2fda-4b08-8b1f-b528ac7976ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:54.707780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48d4dff-2fda-4b08-8b1f-b528ac7976ed None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:54.729509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:54.730085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:54.730366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:54.730716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:54.731601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159, user.id=9ebbfe4256394e0899a882172e982b2a) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:54.731915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:54.733449 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:54.740820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 102/199] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:54 2022] GET /identity/v3/role_assignments?user.id=9ebbfe4256394e0899a882172e982b2a&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=f21c9b5697b747d39bf8f104797da245 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:54.785499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:54.796090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:54.853410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 98/200] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:54.858056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4dff-2fda-4b08-8b1f-b528ac7976ed None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:54.971667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:54.973360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db4ad0b-ca6b-4daf-a1e2-16a9dd320715 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:55.040014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d4dff-2fda-4b08-8b1f-b528ac7976ed None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:55.041840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d84c-acc0-47b1-8fcd-b97874ecc25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:55.042504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d84c-acc0-47b1-8fcd-b97874ecc25a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:55.042781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d84c-acc0-47b1-8fcd-b97874ecc25a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:55.043051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca3d84c-acc0-47b1-8fcd-b97874ecc25a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:55.063463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca3d84c-acc0-47b1-8fcd-b97874ecc25a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9ca3d84c-acc0-47b1-8fcd-b97874ecc25a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:55.070476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:55.071356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:55.072124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 103/201] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:24:55.080298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d84c-acc0-47b1-8fcd-b97874ecc25a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:55.105087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f593390-1440-4f21-9e24-1002314067b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:55.105728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f593390-1440-4f21-9e24-1002314067b8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:55.106040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f593390-1440-4f21-9e24-1002314067b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:55.106314 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f593390-1440-4f21-9e24-1002314067b8 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:55.107448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f593390-1440-4f21-9e24-1002314067b8 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:55.108970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f593390-1440-4f21-9e24-1002314067b8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:55.110826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 99/202] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:54 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:55.116462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f593390-1440-4f21-9e24-1002314067b8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:55.162776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:55.239667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f593390-1440-4f21-9e24-1002314067b8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:55.297239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca3d84c-acc0-47b1-8fcd-b97874ecc25a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:55.300941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:55.301752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:55.303115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:55.303538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:55.304504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] RBAC: Adding query filter params (role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159, user.id=9ebbfe4256394e0899a882172e982b2a) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:55.308416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:55.310178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:55.322186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 100/203] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:55 2022] GET /identity/v3/role_assignments?user.id=9ebbfe4256394e0899a882172e982b2a&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:55.374415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:55.375050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:55.375338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:55.375616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:55.376310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:55.376622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:55.378692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:55.390166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 104/204] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:55.396801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:55.523564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce312455-c718-4d47-ab5a-a8e1fa7f23ad None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:55.526560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:55.564287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e7fe-9df5-400d-a1da-8f2cb4bbdef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:55.565692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e7fe-9df5-400d-a1da-8f2cb4bbdef1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:55.566147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e7fe-9df5-400d-a1da-8f2cb4bbdef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:55.566703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5990e7fe-9df5-400d-a1da-8f2cb4bbdef1 None admin] PATH_INFO: `/v3/users/1ec7215957414d6bbe46c2fb6313e7c8` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:55.568092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e7fe-9df5-400d-a1da-8f2cb4bbdef1 None admin] RBAC: Authorizing `identity:get_user(user_id=1ec7215957414d6bbe46c2fb6313e7c8)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:55.569745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5990e7fe-9df5-400d-a1da-8f2cb4bbdef1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:55.571930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 101/205] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:55 2022] GET /identity/v3/users/1ec7215957414d6bbe46c2fb6313e7c8 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:55.579821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:55.620482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:55.714778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf11b17-ef22-4e7a-a0e5-a10f9a6d9a41 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:55.756964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f6f93-e29a-4dc7-9ee8-d383f0ec29b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:55.757585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f6f93-e29a-4dc7-9ee8-d383f0ec29b8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:55.757867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f6f93-e29a-4dc7-9ee8-d383f0ec29b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:55.758165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f6f93-e29a-4dc7-9ee8-d383f0ec29b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:55.853462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f6f93-e29a-4dc7-9ee8-d383f0ec29b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:55.858917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f6f93-e29a-4dc7-9ee8-d383f0ec29b8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:55.886174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:55.969893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 105/206] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:55.976527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e7fe-9df5-400d-a1da-8f2cb4bbdef1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:56.110865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5990e7fe-9df5-400d-a1da-8f2cb4bbdef1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:56.150477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995ba0b-d5ad-4b4c-a16e-274ec38a7c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:56.151101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ba0b-d5ad-4b4c-a16e-274ec38a7c29 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:56.151382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ba0b-d5ad-4b4c-a16e-274ec38a7c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:56.151653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995ba0b-d5ad-4b4c-a16e-274ec38a7c29 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:56.152778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995ba0b-d5ad-4b4c-a16e-274ec38a7c29 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:56.154256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995ba0b-d5ad-4b4c-a16e-274ec38a7c29 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:56.155893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 102/207] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:55 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:56.163025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f6f93-e29a-4dc7-9ee8-d383f0ec29b8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:56.289408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f6f93-e29a-4dc7-9ee8-d383f0ec29b8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:56.313385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:56.336997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b2c54-f2ca-4a5b-abd6-2dbdb0be2271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:56.337626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2c54-f2ca-4a5b-abd6-2dbdb0be2271 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:56.337927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2c54-f2ca-4a5b-abd6-2dbdb0be2271 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:56.338205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2c54-f2ca-4a5b-abd6-2dbdb0be2271 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:56.338945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2c54-f2ca-4a5b-abd6-2dbdb0be2271 None admin] RBAC: Adding query filter params (role.id=1dc9ff2bc5034e32b66a5d9d3e388009, scope.project.id=0984058b3d114dee94ef957c8703fd0a, user.id=1ec7215957414d6bbe46c2fb6313e7c8) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:56.339252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2c54-f2ca-4a5b-abd6-2dbdb0be2271 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:56.340981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2c54-f2ca-4a5b-abd6-2dbdb0be2271 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:56.347598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 106/208] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:56 2022] GET /identity/v3/role_assignments?user.id=1ec7215957414d6bbe46c2fb6313e7c8&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=1dc9ff2bc5034e32b66a5d9d3e388009 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:56.589166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f361d6-f600-46e7-8a94-6f8d26a73779 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:56.589678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f361d6-f600-46e7-8a94-6f8d26a73779 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:56.589750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f361d6-f600-46e7-8a94-6f8d26a73779 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:56.591092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 103/209] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:56.596804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9116f2-29f0-4950-9088-c514fbd150af None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:56.597101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9116f2-29f0-4950-9088-c514fbd150af None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:56.597379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9116f2-29f0-4950-9088-c514fbd150af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:56.617785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dd9116f2-29f0-4950-9088-c514fbd150af None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:56.619028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dd9116f2-29f0-4950-9088-c514fbd150af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:56.695489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 107/210] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:56.857621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec899-5bd4-4d09-b047-8b77e32c621f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:56.857806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec899-5bd4-4d09-b047-8b77e32c621f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:56.858121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ec899-5bd4-4d09-b047-8b77e32c621f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:56.859683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 104/211] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:56.866781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6d3c-52a1-4216-ad37-e6f9089e0834 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:56.867345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6d3c-52a1-4216-ad37-e6f9089e0834 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:56.867834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a6d3c-52a1-4216-ad37-e6f9089e0834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:56.886614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-622a6d3c-52a1-4216-ad37-e6f9089e0834 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:56.888118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-622a6d3c-52a1-4216-ad37-e6f9089e0834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:56.962911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 108/212] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:56.979400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ec899-5bd4-4d09-b047-8b77e32c621f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:57.025653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:57.087936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ec899-5bd4-4d09-b047-8b77e32c621f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:57.123930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ca17-a07e-4b6b-837f-3bf881382cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:57.124875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ca17-a07e-4b6b-837f-3bf881382cba None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.125384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ca17-a07e-4b6b-837f-3bf881382cba None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.125845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1ca17-a07e-4b6b-837f-3bf881382cba None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.137122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d1ca17-a07e-4b6b-837f-3bf881382cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-72d1ca17-a07e-4b6b-837f-3bf881382cba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:57.142202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:57.143037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:24:57.144404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:24:57.146901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 105/213] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:57.155036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a6d3c-52a1-4216-ad37-e6f9089e0834 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:57.204041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:57.268022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a6d3c-52a1-4216-ad37-e6f9089e0834 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:57.269201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ca17-a07e-4b6b-837f-3bf881382cba None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:57.305580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc595c87-040d-40d1-8680-dd5ca3c8a4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:57.306475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595c87-040d-40d1-8680-dd5ca3c8a4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.306752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595c87-040d-40d1-8680-dd5ca3c8a4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.307025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595c87-040d-40d1-8680-dd5ca3c8a4a1 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.307692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc595c87-040d-40d1-8680-dd5ca3c8a4a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:57.307991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc595c87-040d-40d1-8680-dd5ca3c8a4a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:57.309389 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc595c87-040d-40d1-8680-dd5ca3c8a4a1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:57.318443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 109/214] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:24:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:57.319492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd80a56-b2c7-4229-8dff-6e00921e05fb None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.319778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd80a56-b2c7-4229-8dff-6e00921e05fb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.320053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd80a56-b2c7-4229-8dff-6e00921e05fb None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.321387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 110/215] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:24:57.323585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd80a56-b2c7-4229-8dff-6e00921e05fb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:57.387677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:57.391180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1ca17-a07e-4b6b-837f-3bf881382cba None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:57.428696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bce04-9725-48ee-92a2-e676f9b7acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:57.429329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bce04-9725-48ee-92a2-e676f9b7acc0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.429613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bce04-9725-48ee-92a2-e676f9b7acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.429901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bce04-9725-48ee-92a2-e676f9b7acc0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.431283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bce04-9725-48ee-92a2-e676f9b7acc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:57.432726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8bce04-9725-48ee-92a2-e676f9b7acc0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:57.434624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 106/216] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:24:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:57.441843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fbbc-3aa0-4868-aa09-74d5e9f6ede6 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.442440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fbbc-3aa0-4868-aa09-74d5e9f6ede6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.442915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839fbbc-3aa0-4868-aa09-74d5e9f6ede6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.450670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd80a56-b2c7-4229-8dff-6e00921e05fb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:57.459459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:57.463432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8839fbbc-3aa0-4868-aa09-74d5e9f6ede6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:57.464669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8839fbbc-3aa0-4868-aa09-74d5e9f6ede6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:57.491088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa1e0a-940f-4663-ab01-1a43dbc22566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:57.492085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa1e0a-940f-4663-ab01-1a43dbc22566 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.492437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa1e0a-940f-4663-ab01-1a43dbc22566 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.492790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa1e0a-940f-4663-ab01-1a43dbc22566 None admin] PATH_INFO: `/v3/users/85b52ea58c594ae794b4c7c7b711bd44` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.508712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa1e0a-940f-4663-ab01-1a43dbc22566 None admin] RBAC: Authorizing `identity:get_user(user_id=85b52ea58c594ae794b4c7c7b711bd44)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:57.510109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa1e0a-940f-4663-ab01-1a43dbc22566 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:57.511924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 111/217] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:57 2022] GET /identity/v3/users/85b52ea58c594ae794b4c7c7b711bd44 => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:57.512507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa1e0a-940f-4663-ab01-1a43dbc22566 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:57.546190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 107/218] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:24:57.546190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fbbc-3aa0-4868-aa09-74d5e9f6ede6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:57.638554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa1e0a-940f-4663-ab01-1a43dbc22566 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:57.679069 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:57.680663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0b8158-eddc-48ed-b64c-f728ecb749d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:57.682393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b8158-eddc-48ed-b64c-f728ecb749d4 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.682672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b8158-eddc-48ed-b64c-f728ecb749d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.682951 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0b8158-eddc-48ed-b64c-f728ecb749d4 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.683613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b8158-eddc-48ed-b64c-f728ecb749d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:57.685074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0b8158-eddc-48ed-b64c-f728ecb749d4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:57.688776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839fbbc-3aa0-4868-aa09-74d5e9f6ede6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:57.713995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 112/219] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:24:57 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:24:57.719211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba6fc-b999-4db5-a592-b680252ad3a9 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.719821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba6fc-b999-4db5-a592-b680252ad3a9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.720203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ba6fc-b999-4db5-a592-b680252ad3a9 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.722461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 113/220] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:24:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:24:57.728458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e216c-c2ad-4952-bd45-15b9e28cec3a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.729589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e216c-c2ad-4952-bd45-15b9e28cec3a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.729928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e216c-c2ad-4952-bd45-15b9e28cec3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.744599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833842b-47b8-4541-ba0f-b44e6383f09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:57.745233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833842b-47b8-4541-ba0f-b44e6383f09c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:57.745519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833842b-47b8-4541-ba0f-b44e6383f09c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:57.745799 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833842b-47b8-4541-ba0f-b44e6383f09c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:57.757632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-138e216c-c2ad-4952-bd45-15b9e28cec3a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:24:57.759257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-138e216c-c2ad-4952-bd45-15b9e28cec3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:24:57.779890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:57.837073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833842b-47b8-4541-ba0f-b44e6383f09c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:57.838759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833842b-47b8-4541-ba0f-b44e6383f09c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:57.855549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 114/221] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:24:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:24:57.856263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e216c-c2ad-4952-bd45-15b9e28cec3a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:57.950248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:57.956472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 108/222] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:24:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:24:57.961981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833842b-47b8-4541-ba0f-b44e6383f09c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:57.980156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e216c-c2ad-4952-bd45-15b9e28cec3a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.018824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269e99-c9bc-4114-95f4-21f9401fbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:58.019537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269e99-c9bc-4114-95f4-21f9401fbb6a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:58.019820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269e99-c9bc-4114-95f4-21f9401fbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:58.020095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f269e99-c9bc-4114-95f4-21f9401fbb6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:58.031695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f269e99-c9bc-4114-95f4-21f9401fbb6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0f269e99-c9bc-4114-95f4-21f9401fbb6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:58.037387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:58.038379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:24:58.039193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:58.039830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 115/223] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:58.045064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269e99-c9bc-4114-95f4-21f9401fbb6a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:58.060132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:58.080176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833842b-47b8-4541-ba0f-b44e6383f09c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.116804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba269-c4e0-48fd-865e-b1a8bade6177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:58.117445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba269-c4e0-48fd-865e-b1a8bade6177 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:58.117728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba269-c4e0-48fd-865e-b1a8bade6177 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:58.118038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ba269-c4e0-48fd-865e-b1a8bade6177 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:58.119834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba269-c4e0-48fd-865e-b1a8bade6177 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:58.120610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ba269-c4e0-48fd-865e-b1a8bade6177 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:58.122587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 109/224] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:57 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:58.129823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba269-c4e0-48fd-865e-b1a8bade6177 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:58.175816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f269e99-c9bc-4114-95f4-21f9401fbb6a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.220551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:58.221775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:58.222435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:58.225923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:58.225923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:58.225923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:58.225923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:58.226750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:58.235832 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 116/225] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:24:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:58.240170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:58.274304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ba269-c4e0-48fd-865e-b1a8bade6177 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.314653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:58.315334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:58.315846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:58.316234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:58.316984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] RBAC: Adding query filter params (role.id=e104332d9de24bed8d32257cab931633, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159, user.id=85b52ea58c594ae794b4c7c7b711bd44) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:58.317302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:58.318887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:58.323378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:58.326504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 110/226] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:24:58 2022] GET /identity/v3/role_assignments?user.id=85b52ea58c594ae794b4c7c7b711bd44&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=e104332d9de24bed8d32257cab931633 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:58.327775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:58.396262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502300a-c338-4439-9edf-8cc7d18a4964 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.474527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e69d2-9caf-4437-a4e1-547ce95ecdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:58.475098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e69d2-9caf-4437-a4e1-547ce95ecdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:58.475384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e69d2-9caf-4437-a4e1-547ce95ecdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:58.475661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e69d2-9caf-4437-a4e1-547ce95ecdd1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:58.499415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e69d2-9caf-4437-a4e1-547ce95ecdd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1d1e69d2-9caf-4437-a4e1-547ce95ecdd1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:24:58.506535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:24:58.507419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:24:58.508198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:24:58.511224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 117/227] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:24:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:24:58.512857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e69d2-9caf-4437-a4e1-547ce95ecdd1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:58.571807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e5051-b3e9-4c83-b130-c887568f42ff None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.638886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:58.646564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e69d2-9caf-4437-a4e1-547ce95ecdd1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.657208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec0163-9072-489e-91d2-5983f655a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:58.658229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0163-9072-489e-91d2-5983f655a29f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:58.658688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0163-9072-489e-91d2-5983f655a29f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:58.659254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec0163-9072-489e-91d2-5983f655a29f None admin] PATH_INFO: `/v3/users/9ebbfe4256394e0899a882172e982b2a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:58.661260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec0163-9072-489e-91d2-5983f655a29f None admin] RBAC: Authorizing `identity:get_user(user_id=9ebbfe4256394e0899a882172e982b2a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:58.666112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec0163-9072-489e-91d2-5983f655a29f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:58.669281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 111/228] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:58 2022] GET /identity/v3/users/9ebbfe4256394e0899a882172e982b2a => generated 283 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:58.675094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec0163-9072-489e-91d2-5983f655a29f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:58.730375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:58.742885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:58.743652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:58.743994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:58.744342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:58.745202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:24:58.745659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:58.747149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:58.776536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 118/229] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:24:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:58.788102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:58.803395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec0163-9072-489e-91d2-5983f655a29f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.840216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da1903-08b7-40ac-86ab-9761f5192252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:58.841167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da1903-08b7-40ac-86ab-9761f5192252 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:58.841628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da1903-08b7-40ac-86ab-9761f5192252 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:58.842105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da1903-08b7-40ac-86ab-9761f5192252 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:58.843476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da1903-08b7-40ac-86ab-9761f5192252 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:58.845203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da1903-08b7-40ac-86ab-9761f5192252 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:58.848384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 112/230] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:58 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:58.854810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da1903-08b7-40ac-86ab-9761f5192252 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:58.931327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:58.971748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da1903-08b7-40ac-86ab-9761f5192252 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:58.990919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9562aac7-622e-40e2-9a99-5ca332e7db4d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:59.027537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a41497-6542-478e-b5db-356c5b75fa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:59.028748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41497-6542-478e-b5db-356c5b75fa6c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:59.029263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41497-6542-478e-b5db-356c5b75fa6c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:59.029737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a41497-6542-478e-b5db-356c5b75fa6c None admin] PATH_INFO: `/v3/users/9ebbfe4256394e0899a882172e982b2a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:59.031088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a41497-6542-478e-b5db-356c5b75fa6c None admin] RBAC: Authorizing `identity:get_user(user_id=9ebbfe4256394e0899a882172e982b2a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:59.032738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a41497-6542-478e-b5db-356c5b75fa6c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:59.035695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 119/231] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:24:58 2022] GET /identity/v3/users/9ebbfe4256394e0899a882172e982b2a => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:24:59.041702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a41497-6542-478e-b5db-356c5b75fa6c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:59.098685 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41b48-fb82-40dd-b9c8-40c3851662da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:59.099384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41b48-fb82-40dd-b9c8-40c3851662da None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:59.099674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41b48-fb82-40dd-b9c8-40c3851662da None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:59.099956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb41b48-fb82-40dd-b9c8-40c3851662da None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/users/9ebbfe4256394e0899a882172e982b2a/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:59.106704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb41b48-fb82-40dd-b9c8-40c3851662da None admin] RBAC: Authorizing `identity:create_grant(project_id=19bae8bf30dd4530b67b9f4d3bf46159, user_id=9ebbfe4256394e0899a882172e982b2a, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:59.108192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb41b48-fb82-40dd-b9c8-40c3851662da None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:59.113524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:59.141049 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 113/232] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:24:58 2022] PUT /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/users/9ebbfe4256394e0899a882172e982b2a/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:24:59.159629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a41497-6542-478e-b5db-356c5b75fa6c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:59.203577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d787d3dc-16f1-4f90-a58a-c25c8ed87a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:59.204251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d3dc-16f1-4f90-a58a-c25c8ed87a0c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:59.204535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d3dc-16f1-4f90-a58a-c25c8ed87a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:59.204812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d787d3dc-16f1-4f90-a58a-c25c8ed87a0c None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:59.206343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787d3dc-16f1-4f90-a58a-c25c8ed87a0c None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:59.207869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d787d3dc-16f1-4f90-a58a-c25c8ed87a0c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:59.209788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 120/233] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:24:59 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:24:59.216290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41b48-fb82-40dd-b9c8-40c3851662da None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:24:59.370551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb41b48-fb82-40dd-b9c8-40c3851662da None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:24:59.398580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:24:59.408916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79d33c-4f31-417b-9f05-ae2c0a65a725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:24:59.409820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d33c-4f31-417b-9f05-ae2c0a65a725 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:24:59.410334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d33c-4f31-417b-9f05-ae2c0a65a725 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:24:59.410838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79d33c-4f31-417b-9f05-ae2c0a65a725 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/users/9ebbfe4256394e0899a882172e982b2a/roles/04b06cf4afbb4f3fa6cb347496ae7a81` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:24:59.413308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79d33c-4f31-417b-9f05-ae2c0a65a725 None admin] RBAC: Authorizing `identity:create_grant(project_id=19bae8bf30dd4530b67b9f4d3bf46159, user_id=9ebbfe4256394e0899a882172e982b2a, role_id=04b06cf4afbb4f3fa6cb347496ae7a81)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:24:59.414818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79d33c-4f31-417b-9f05-ae2c0a65a725 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:24:59.433770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 114/234] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:24:59 2022] PUT /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/users/9ebbfe4256394e0899a882172e982b2a/roles/04b06cf4afbb4f3fa6cb347496ae7a81 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:00.224403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa11d-8a93-4f92-b42b-a72e2623df8f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:00.224958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa11d-8a93-4f92-b42b-a72e2623df8f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:00.224958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0fa11d-8a93-4f92-b42b-a72e2623df8f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:00.226382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 121/235] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:00.231567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e9710-0b89-4fd1-87aa-a1c664efefea None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:00.231968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e9710-0b89-4fd1-87aa-a1c664efefea None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:00.232134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e9710-0b89-4fd1-87aa-a1c664efefea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:00.258885 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4f8e9710-0b89-4fd1-87aa-a1c664efefea None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:00.260106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4f8e9710-0b89-4fd1-87aa-a1c664efefea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:00.352330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 115/236] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:00.364668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dc0bb-784f-44cb-956f-328cc311d17a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:00.364974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dc0bb-784f-44cb-956f-328cc311d17a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:00.365233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dc0bb-784f-44cb-956f-328cc311d17a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:00.366861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 122/237] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:00.375357 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a09c-e7cb-455e-8380-cf047154d74c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:00.375648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a09c-e7cb-455e-8380-cf047154d74c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:00.375928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962a09c-e7cb-455e-8380-cf047154d74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:00.399082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e962a09c-e7cb-455e-8380-cf047154d74c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:00.400276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e962a09c-e7cb-455e-8380-cf047154d74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:00.496848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 116/238] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:00.675521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4f58-3c56-4fce-9ca7-6a111e25e234 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:00.675942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4f58-3c56-4fce-9ca7-6a111e25e234 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:00.676232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb4f58-3c56-4fce-9ca7-6a111e25e234 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:00.677586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 123/239] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:00.683252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f516-b09f-4f6b-8091-e130ed653499 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:00.683763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f516-b09f-4f6b-8091-e130ed653499 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:00.684240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544f516-b09f-4f6b-8091-e130ed653499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:00.705731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e544f516-b09f-4f6b-8091-e130ed653499 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:00.707379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e544f516-b09f-4f6b-8091-e130ed653499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:00.770715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:00.804692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 117/240] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:00.817405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb4f58-3c56-4fce-9ca7-6a111e25e234 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:00.880505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f516-b09f-4f6b-8091-e130ed653499 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:00.992275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb4f58-3c56-4fce-9ca7-6a111e25e234 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.028705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bc208-9446-4cb0-a41c-7a31b276d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.029345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc208-9446-4cb0-a41c-7a31b276d8ca None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.029634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc208-9446-4cb0-a41c-7a31b276d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.029941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bc208-9446-4cb0-a41c-7a31b276d8ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.042287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bc208-9446-4cb0-a41c-7a31b276d8ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-5d8bc208-9446-4cb0-a41c-7a31b276d8ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:01.048243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:01.049061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:01.049867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 124/241] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:01.050525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:01.055671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bc208-9446-4cb0-a41c-7a31b276d8ca None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:01.096153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544f516-b09f-4f6b-8091-e130ed653499 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.141329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f45a4a-cc2a-4556-a7d0-3dadc7af6649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.142010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45a4a-cc2a-4556-a7d0-3dadc7af6649 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.142296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45a4a-cc2a-4556-a7d0-3dadc7af6649 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.142575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f45a4a-cc2a-4556-a7d0-3dadc7af6649 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.144852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f45a4a-cc2a-4556-a7d0-3dadc7af6649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:01.146365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f45a4a-cc2a-4556-a7d0-3dadc7af6649 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:01.148206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 118/242] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:01.148982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f45a4a-cc2a-4556-a7d0-3dadc7af6649 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:01.213150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bc208-9446-4cb0-a41c-7a31b276d8ca None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.214056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:01.262168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.265568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.265855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.266156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.266835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:01.267149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:01.269570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:01.279047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 125/243] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:01.280029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:01.289419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f45a4a-cc2a-4556-a7d0-3dadc7af6649 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.336230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0d44a-d54c-4686-bd8d-b2d00e3738c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.337043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d44a-d54c-4686-bd8d-b2d00e3738c1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.337585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d44a-d54c-4686-bd8d-b2d00e3738c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.338136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb0d44a-d54c-4686-bd8d-b2d00e3738c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.341539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:01.352894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb0d44a-d54c-4686-bd8d-b2d00e3738c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-1fb0d44a-d54c-4686-bd8d-b2d00e3738c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:01.360216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:01.361070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:01.362709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:01.364614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 119/244] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:01.365614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0d44a-d54c-4686-bd8d-b2d00e3738c1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:01.408127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e53f7a-2130-4928-ae83-cb3c0db86f4e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.447461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816c10-4017-490d-af67-ce030fae6672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.448418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816c10-4017-490d-af67-ce030fae6672 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.448418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816c10-4017-490d-af67-ce030fae6672 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.448672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f816c10-4017-490d-af67-ce030fae6672 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.449283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816c10-4017-490d-af67-ce030fae6672 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:01.451231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f816c10-4017-490d-af67-ce030fae6672 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:01.477275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb0d44a-d54c-4686-bd8d-b2d00e3738c1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.480780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:01.489909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 126/245] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:25:01 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:01.489909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816c10-4017-490d-af67-ce030fae6672 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:01.591856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c66701-6447-4258-bd0a-699baec17c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.592522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c66701-6447-4258-bd0a-699baec17c9a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.592811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c66701-6447-4258-bd0a-699baec17c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.593084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c66701-6447-4258-bd0a-699baec17c9a None admin] PATH_INFO: `/v3/users/ab94e83a69444ff4963285ed35ccc06d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.615683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f816c10-4017-490d-af67-ce030fae6672 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.622922 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c66701-6447-4258-bd0a-699baec17c9a None admin] RBAC: Authorizing `identity:get_user(user_id=ab94e83a69444ff4963285ed35ccc06d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:01.624688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c66701-6447-4258-bd0a-699baec17c9a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:01.626247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:01.626983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 120/246] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:01 2022] GET /identity/v3/users/ab94e83a69444ff4963285ed35ccc06d => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:01.633125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c66701-6447-4258-bd0a-699baec17c9a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:01.663248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.664027 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.664320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.664594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.665274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:01.665580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:01.667019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:01.681371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 127/247] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:01.686494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:01.748782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c66701-6447-4258-bd0a-699baec17c9a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.800659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cb616c-8e9e-40ac-b314-93b8acda295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.802057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb616c-8e9e-40ac-b314-93b8acda295c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.802717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb616c-8e9e-40ac-b314-93b8acda295c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.803535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cb616c-8e9e-40ac-b314-93b8acda295c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.810378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952297f-e9d7-4f82-b52f-0cba8f3c38ee None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:01.845916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:01.860105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58181ca-e96f-482f-bd7f-7f6da645c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:01.861187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58181ca-e96f-482f-bd7f-7f6da645c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.861486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58181ca-e96f-482f-bd7f-7f6da645c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.861852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58181ca-e96f-482f-bd7f-7f6da645c6e0 None admin] PATH_INFO: `/v3/users/85b52ea58c594ae794b4c7c7b711bd44` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.863494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58181ca-e96f-482f-bd7f-7f6da645c6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=85b52ea58c594ae794b4c7c7b711bd44)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:01.865372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58181ca-e96f-482f-bd7f-7f6da645c6e0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:01.867734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 128/248] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:01 2022] GET /identity/v3/users/85b52ea58c594ae794b4c7c7b711bd44 => generated 297 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:01.868932 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b924af-8f2e-4701-be0d-47501304cb57 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.869221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b924af-8f2e-4701-be0d-47501304cb57 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.869501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b924af-8f2e-4701-be0d-47501304cb57 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.875357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 129/249] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:01.876596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d64e-f54e-4aa2-8abc-239b13a7bcf6 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:01.876883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d64e-f54e-4aa2-8abc-239b13a7bcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:01.877154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971d64e-f54e-4aa2-8abc-239b13a7bcf6 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:01.878692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 130/250] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:01.879416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971d64e-f54e-4aa2-8abc-239b13a7bcf6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:01.905389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb616c-8e9e-40ac-b314-93b8acda295c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:01.906909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cb616c-8e9e-40ac-b314-93b8acda295c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:01.943279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:02.026361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971d64e-f54e-4aa2-8abc-239b13a7bcf6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:02.033422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 121/251] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:25:02.035709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a7ac-fa85-49aa-81e8-dd539ad90103 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:02.036335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a7ac-fa85-49aa-81e8-dd539ad90103 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:02.036754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1884a7ac-fa85-49aa-81e8-dd539ad90103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:02.059091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1884a7ac-fa85-49aa-81e8-dd539ad90103 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:02.060532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1884a7ac-fa85-49aa-81e8-dd539ad90103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:02.078720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f86ba-a40f-4b44-8fd8-ded8e0298fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:02.079370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f86ba-a40f-4b44-8fd8-ded8e0298fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:02.079711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f86ba-a40f-4b44-8fd8-ded8e0298fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:02.079989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f86ba-a40f-4b44-8fd8-ded8e0298fc6 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:02.082172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f86ba-a40f-4b44-8fd8-ded8e0298fc6 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:02.083648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f86ba-a40f-4b44-8fd8-ded8e0298fc6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:02.085936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 131/252] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:01 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:02.087535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa263-7d5f-401a-b769-9d9714f481e0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:02.087868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa263-7d5f-401a-b769-9d9714f481e0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:02.088138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fa263-7d5f-401a-b769-9d9714f481e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:02.113687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d20fa263-7d5f-401a-b769-9d9714f481e0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:02.115147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d20fa263-7d5f-401a-b769-9d9714f481e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:02.129846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:02.142942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 122/253] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:02.145135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884a7ac-fa85-49aa-81e8-dd539ad90103 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:02.209700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 132/254] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:02.214071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fa263-7d5f-401a-b769-9d9714f481e0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:02.251479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:02.311872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1884a7ac-fa85-49aa-81e8-dd539ad90103 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:02.345527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fa263-7d5f-401a-b769-9d9714f481e0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:02.369637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc0c14-2ad0-4305-8648-3e788fad699e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:02.370222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc0c14-2ad0-4305-8648-3e788fad699e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:02.370504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc0c14-2ad0-4305-8648-3e788fad699e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:02.370776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc0c14-2ad0-4305-8648-3e788fad699e None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:02.378142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc0c14-2ad0-4305-8648-3e788fad699e None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:02.378142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc0c14-2ad0-4305-8648-3e788fad699e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:02.378793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 123/255] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:02 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:02.384553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc0c14-2ad0-4305-8648-3e788fad699e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:02.407523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbc74a-18d9-4261-8112-a2f34c2c7fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:02.408658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc74a-18d9-4261-8112-a2f34c2c7fe3 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:02.409142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc74a-18d9-4261-8112-a2f34c2c7fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:02.409613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cbc74a-18d9-4261-8112-a2f34c2c7fe3 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/users/85b52ea58c594ae794b4c7c7b711bd44/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:02.419749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbc74a-18d9-4261-8112-a2f34c2c7fe3 None admin] RBAC: Authorizing `identity:create_grant(project_id=19bae8bf30dd4530b67b9f4d3bf46159, user_id=85b52ea58c594ae794b4c7c7b711bd44, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:02.421490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cbc74a-18d9-4261-8112-a2f34c2c7fe3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:02.448383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 133/256] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:25:02 2022] PUT /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/users/85b52ea58c594ae794b4c7c7b711bd44/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:02.528665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:02.598347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc0c14-2ad0-4305-8648-3e788fad699e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:02.615018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbc74a-18d9-4261-8112-a2f34c2c7fe3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:02.646857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:02.647829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:02.648121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:02.648404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:02.649150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] RBAC: Adding query filter params (role.id=1dc9ff2bc5034e32b66a5d9d3e388009, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159, user.id=ab94e83a69444ff4963285ed35ccc06d) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:02.649467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:02.650946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:02.657698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 124/257] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:02 2022] GET /identity/v3/role_assignments?user.id=ab94e83a69444ff4963285ed35ccc06d&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=1dc9ff2bc5034e32b66a5d9d3e388009 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:02.664278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:02.812750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:02.823732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cbc74a-18d9-4261-8112-a2f34c2c7fe3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:02.869597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b382c4-a6e2-466e-8dac-7b2084b55253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:02.870309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b382c4-a6e2-466e-8dac-7b2084b55253 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:02.870598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b382c4-a6e2-466e-8dac-7b2084b55253 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:02.870878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b382c4-a6e2-466e-8dac-7b2084b55253 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:02.884489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b382c4-a6e2-466e-8dac-7b2084b55253 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:02.887087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cffa41-8dc3-4a25-b7fd-594aa393a2db None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c0b382c4-a6e2-466e-8dac-7b2084b55253 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:02.890461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:02.891361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:02.893550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 134/258] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:02.899996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b382c4-a6e2-466e-8dac-7b2084b55253 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:02.954774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:02.981754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ce2a3-6174-4ce1-b780-5df6817fba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:02.982801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ce2a3-6174-4ce1-b780-5df6817fba4f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:02.983283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ce2a3-6174-4ce1-b780-5df6817fba4f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:02.983752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0ce2a3-6174-4ce1-b780-5df6817fba4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:03.011889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0ce2a3-6174-4ce1-b780-5df6817fba4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7f0ce2a3-6174-4ce1-b780-5df6817fba4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:03.019774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:03.020713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:03.021519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:03.025644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 125/259] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:25:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:03.034598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ce2a3-6174-4ce1-b780-5df6817fba4f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:03.140643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b382c4-a6e2-466e-8dac-7b2084b55253 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:03.212673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:03.219464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:03.220118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:03.220601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:03.221808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:03.223036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:03.224840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:03.247494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 135/260] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:03.254094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:03.281066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0ce2a3-6174-4ce1-b780-5df6817fba4f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:03.292297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:03.371544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:03.372178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:03.372472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:03.372754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:03.373444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:03.373753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:03.375192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:03.394349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 126/261] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:03.402931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:03.430413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da39c1-09a9-46f6-8018-f70650b84d77 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:03.490611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dacb70-ebc6-447a-bc9a-69fe1fba7086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:03.491183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacb70-ebc6-447a-bc9a-69fe1fba7086 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:03.491468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacb70-ebc6-447a-bc9a-69fe1fba7086 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:03.491748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dacb70-ebc6-447a-bc9a-69fe1fba7086 None admin] PATH_INFO: `/v3/users/9ebbfe4256394e0899a882172e982b2a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:03.497194 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dacb70-ebc6-447a-bc9a-69fe1fba7086 None admin] RBAC: Authorizing `identity:get_user(user_id=9ebbfe4256394e0899a882172e982b2a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:03.498910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dacb70-ebc6-447a-bc9a-69fe1fba7086 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:03.500710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 136/262] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:03 2022] GET /identity/v3/users/9ebbfe4256394e0899a882172e982b2a => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:03.512287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dacb70-ebc6-447a-bc9a-69fe1fba7086 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:03.515164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:03.604195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927ab5bf-eb01-4be9-b81f-54b1b1de679a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:03.660820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81a67-f8f2-4c2a-b37f-0b408b7892ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:03.661485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81a67-f8f2-4c2a-b37f-0b408b7892ff None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:03.661781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81a67-f8f2-4c2a-b37f-0b408b7892ff None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:03.662094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a81a67-f8f2-4c2a-b37f-0b408b7892ff None admin] PATH_INFO: `/v3/users/9ebbfe4256394e0899a882172e982b2a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:03.663512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81a67-f8f2-4c2a-b37f-0b408b7892ff None admin] RBAC: Authorizing `identity:get_user(user_id=9ebbfe4256394e0899a882172e982b2a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:03.665133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a81a67-f8f2-4c2a-b37f-0b408b7892ff None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:03.667280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 127/263] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:03 2022] GET /identity/v3/users/9ebbfe4256394e0899a882172e982b2a => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:03.674813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81a67-f8f2-4c2a-b37f-0b408b7892ff None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:03.722929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:03.739283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dacb70-ebc6-447a-bc9a-69fe1fba7086 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:03.794140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f054d-b2d0-4a1f-9530-19cc87b6c78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:03.794728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f054d-b2d0-4a1f-9530-19cc87b6c78c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:03.795014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f054d-b2d0-4a1f-9530-19cc87b6c78c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:03.795284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f054d-b2d0-4a1f-9530-19cc87b6c78c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:03.889429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f054d-b2d0-4a1f-9530-19cc87b6c78c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:03.890961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f054d-b2d0-4a1f-9530-19cc87b6c78c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:03.944125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a81a67-f8f2-4c2a-b37f-0b408b7892ff None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:03.983382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:03.988029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:04.005993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 137/264] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:04.012433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f054d-b2d0-4a1f-9530-19cc87b6c78c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:04.046593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228b3d4-72f3-4821-a863-38afba8450b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:04.047150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228b3d4-72f3-4821-a863-38afba8450b6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:04.047439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228b3d4-72f3-4821-a863-38afba8450b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:04.047719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228b3d4-72f3-4821-a863-38afba8450b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:04.173163 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228b3d4-72f3-4821-a863-38afba8450b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:04.175900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228b3d4-72f3-4821-a863-38afba8450b6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:04.227284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f054d-b2d0-4a1f-9530-19cc87b6c78c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:04.316392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e02a88-2fe5-48c6-a7ab-c57804830a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:04.317081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02a88-2fe5-48c6-a7ab-c57804830a86 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:04.317371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02a88-2fe5-48c6-a7ab-c57804830a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:04.317655 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e02a88-2fe5-48c6-a7ab-c57804830a86 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:04.319030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e02a88-2fe5-48c6-a7ab-c57804830a86 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:04.320549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e02a88-2fe5-48c6-a7ab-c57804830a86 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:04.322289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 138/265] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:04 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:04.323519 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a05e6-b155-4a1e-a643-b96cec25d73b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:04.323810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a05e6-b155-4a1e-a643-b96cec25d73b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:04.324095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a05e6-b155-4a1e-a643-b96cec25d73b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:04.325338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 139/266] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:04.333393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a05e6-b155-4a1e-a643-b96cec25d73b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:04.405573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 128/267] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:04.407830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33ab9-d677-4363-8703-2d78d6c1b1cc None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:04.408524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33ab9-d677-4363-8703-2d78d6c1b1cc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:04.409256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b33ab9-d677-4363-8703-2d78d6c1b1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:04.448239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-51b33ab9-d677-4363-8703-2d78d6c1b1cc None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:04.454262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-51b33ab9-d677-4363-8703-2d78d6c1b1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:04.468957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:04.474747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:04.547415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a05e6-b155-4a1e-a643-b96cec25d73b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:04.551641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 129/268] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:04.566728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33ab9-d677-4363-8703-2d78d6c1b1cc None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:04.589990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5a9d07-2b07-4307-9249-1f5ec801eba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:04.591878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9d07-2b07-4307-9249-1f5ec801eba7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:04.592318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9d07-2b07-4307-9249-1f5ec801eba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:04.592778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5a9d07-2b07-4307-9249-1f5ec801eba7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:04.593656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9d07-2b07-4307-9249-1f5ec801eba7 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159, user.id=9ebbfe4256394e0899a882172e982b2a) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:04.594156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9d07-2b07-4307-9249-1f5ec801eba7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:04.595872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5a9d07-2b07-4307-9249-1f5ec801eba7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:04.603065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 140/269] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:04 2022] GET /identity/v3/role_assignments?user.id=9ebbfe4256394e0899a882172e982b2a&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=f21c9b5697b747d39bf8f104797da245 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:04.604976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77654540-24ae-4a32-b218-ae7dc3641cc5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:04.605903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77654540-24ae-4a32-b218-ae7dc3641cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:04.606386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77654540-24ae-4a32-b218-ae7dc3641cc5 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:04.608061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 141/270] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:04.616794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa66e-5a17-4f80-ad7f-39347cc62233 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:04.617435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa66e-5a17-4f80-ad7f-39347cc62233 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:04.617957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5aa66e-5a17-4f80-ad7f-39347cc62233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:04.657824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-df5aa66e-5a17-4f80-ad7f-39347cc62233 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:04.667625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-df5aa66e-5a17-4f80-ad7f-39347cc62233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:04.858293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 142/271] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:04.858483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b33ab9-d677-4363-8703-2d78d6c1b1cc None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:04.892327 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa66e-5a17-4f80-ad7f-39347cc62233 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:04.900729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32acceb-29eb-4264-bc3d-d85c0fcf9140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:04.901486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32acceb-29eb-4264-bc3d-d85c0fcf9140 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:04.901768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32acceb-29eb-4264-bc3d-d85c0fcf9140 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:04.902087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32acceb-29eb-4264-bc3d-d85c0fcf9140 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:04.903352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32acceb-29eb-4264-bc3d-d85c0fcf9140 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:04.904796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32acceb-29eb-4264-bc3d-d85c0fcf9140 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:04.906873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 130/272] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:04 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:04.913106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32acceb-29eb-4264-bc3d-d85c0fcf9140 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:04.932692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:04.981908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:05.070906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32acceb-29eb-4264-bc3d-d85c0fcf9140 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:05.091960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5aa66e-5a17-4f80-ad7f-39347cc62233 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:05.142670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:05.143818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.144097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.144370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.145099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] RBAC: Adding query filter params (role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159, user.id=9ebbfe4256394e0899a882172e982b2a) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:05.145404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:05.148544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:05.160119 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 131/273] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:04 2022] GET /identity/v3/role_assignments?user.id=9ebbfe4256394e0899a882172e982b2a&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:05.160843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababfff6-1572-4d37-83ce-ffc65422aa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:05.161492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababfff6-1572-4d37-83ce-ffc65422aa27 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.161764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababfff6-1572-4d37-83ce-ffc65422aa27 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.166147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababfff6-1572-4d37-83ce-ffc65422aa27 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.179506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:05.184420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababfff6-1572-4d37-83ce-ffc65422aa27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ababfff6-1572-4d37-83ce-ffc65422aa27 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:05.192207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:05.193132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:05.193992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:05.196997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 143/274] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:05.202378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababfff6-1572-4d37-83ce-ffc65422aa27 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:05.298672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:05.332871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2f3b6-046f-466b-b270-4fb91deb819e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:05.375924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412bdae-b926-4c7d-a0d8-feb7fec5951e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:05.376576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412bdae-b926-4c7d-a0d8-feb7fec5951e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.376912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412bdae-b926-4c7d-a0d8-feb7fec5951e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.377381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412bdae-b926-4c7d-a0d8-feb7fec5951e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.379508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412bdae-b926-4c7d-a0d8-feb7fec5951e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:05.381836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412bdae-b926-4c7d-a0d8-feb7fec5951e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:05.383591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 132/275] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:05.389002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412bdae-b926-4c7d-a0d8-feb7fec5951e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:05.418625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababfff6-1572-4d37-83ce-ffc65422aa27 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:05.436453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:05.474214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:05.474842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.475413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.475413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.476144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:05.476410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:05.477810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:05.488198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 144/276] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:05.496032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:05.538704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412bdae-b926-4c7d-a0d8-feb7fec5951e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:05.590975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2335f5d6-5600-4080-8446-7b24e297b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:05.590975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335f5d6-5600-4080-8446-7b24e297b8c2 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.590975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335f5d6-5600-4080-8446-7b24e297b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.590975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2335f5d6-5600-4080-8446-7b24e297b8c2 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.591541 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335f5d6-5600-4080-8446-7b24e297b8c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:05.593584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2335f5d6-5600-4080-8446-7b24e297b8c2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:05.616378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:05.624821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 133/277] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:25:05 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:05.625114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe99-6262-4e60-98a3-42292b656248 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.625570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe99-6262-4e60-98a3-42292b656248 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.625672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fbe99-6262-4e60-98a3-42292b656248 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.632570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 134/278] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:05.634474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1853d-99c8-4145-93c8-5c45f743b02f None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.634762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1853d-99c8-4145-93c8-5c45f743b02f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.635041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1853d-99c8-4145-93c8-5c45f743b02f None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.636416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 135/279] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:05.637580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6021e-e0bb-4217-9fe3-3e5eaefeb8c2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.637860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6021e-e0bb-4217-9fe3-3e5eaefeb8c2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.638180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b6021e-e0bb-4217-9fe3-3e5eaefeb8c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.639184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b9132-5e71-44e8-a0ac-271a67ab86fc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:05.658270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-45b6021e-e0bb-4217-9fe3-3e5eaefeb8c2 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:05.660065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-45b6021e-e0bb-4217-9fe3-3e5eaefeb8c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:05.683180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d1267a-25b1-4426-9159-5ea7846d5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:05.684152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1267a-25b1-4426-9159-5ea7846d5e7e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.684749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1267a-25b1-4426-9159-5ea7846d5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.685239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d1267a-25b1-4426-9159-5ea7846d5e7e None admin] PATH_INFO: `/v3/users/de084e30a744450bb75f5e0dc385d604` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.701445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1267a-25b1-4426-9159-5ea7846d5e7e None admin] RBAC: Authorizing `identity:get_user(user_id=de084e30a744450bb75f5e0dc385d604)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:05.702986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d1267a-25b1-4426-9159-5ea7846d5e7e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:05.704736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 145/280] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:05 2022] GET /identity/v3/users/de084e30a744450bb75f5e0dc385d604 => generated 293 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:05.710591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d815c7-be92-4b0b-b6eb-5798fd5aa398 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.710591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d815c7-be92-4b0b-b6eb-5798fd5aa398 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.710591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d815c7-be92-4b0b-b6eb-5798fd5aa398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.727888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e9d815c7-be92-4b0b-b6eb-5798fd5aa398 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:05.729131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e9d815c7-be92-4b0b-b6eb-5798fd5aa398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:05.753599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 136/281] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:05.754529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6021e-e0bb-4217-9fe3-3e5eaefeb8c2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:05.770816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:05.829929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 146/282] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:05.878116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b6021e-e0bb-4217-9fe3-3e5eaefeb8c2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:05.909395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:05.914502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:05.915114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:05.915395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:05.915668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:05.916554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] RBAC: Adding query filter params (role.id=e104332d9de24bed8d32257cab931633, user.id=de084e30a744450bb75f5e0dc385d604, scope.system=all) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:05.916863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:05.918433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:05.925126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 137/283] 10.222.0.88 () {56 vars in 1308 bytes} [Fri Aug 26 00:25:05 2022] GET /identity/v3/role_assignments?user.id=de084e30a744450bb75f5e0dc385d604&scope.system=all&role.id=e104332d9de24bed8d32257cab931633 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:06.037368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d815c7-be92-4b0b-b6eb-5798fd5aa398 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:06.117643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:06.155226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d815c7-be92-4b0b-b6eb-5798fd5aa398 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:06.232198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb412ae-ba19-4655-81df-5dd25572f087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:06.232844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb412ae-ba19-4655-81df-5dd25572f087 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:06.233120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb412ae-ba19-4655-81df-5dd25572f087 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:06.233387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb412ae-ba19-4655-81df-5dd25572f087 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:06.255038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb412ae-ba19-4655-81df-5dd25572f087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0eb412ae-ba19-4655-81df-5dd25572f087 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:06.259834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:06.260721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:06.261489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 147/284] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:06.270855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb412ae-ba19-4655-81df-5dd25572f087 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:06.296805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05399808-df16-4efd-a43b-b4a8160981f5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:06.323394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:06.335411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298a076-caa0-436d-8bf1-8b803ce80957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:06.336107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a076-caa0-436d-8bf1-8b803ce80957 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:06.336392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a076-caa0-436d-8bf1-8b803ce80957 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:06.336729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298a076-caa0-436d-8bf1-8b803ce80957 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:06.348556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298a076-caa0-436d-8bf1-8b803ce80957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5298a076-caa0-436d-8bf1-8b803ce80957 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:06.354078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:06.354947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:06.355726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 138/285] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:06.363512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298a076-caa0-436d-8bf1-8b803ce80957 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:06.465252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb412ae-ba19-4655-81df-5dd25572f087 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:06.472698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:06.539379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298a076-caa0-436d-8bf1-8b803ce80957 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:06.544678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:06.545310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:06.545589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:06.545861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:06.546565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:06.546927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:06.548261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:06.573579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 148/286] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:06.576420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:06.592407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:06.593352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:06.593840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:06.594372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:06.596664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:06.597677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:06.599904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:06.610898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 139/287] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:06.620007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:06.734501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:06.776569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c20496-9e8c-4ef2-bbb8-bf546739c496 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:06.802354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9431b1aa-b896-4fac-8c30-297dc7319dc9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:06.828491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5317b-7223-40b6-9ba0-d5834d0f3527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:06.829122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5317b-7223-40b6-9ba0-d5834d0f3527 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:06.829401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5317b-7223-40b6-9ba0-d5834d0f3527 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:06.829672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5317b-7223-40b6-9ba0-d5834d0f3527 None admin] PATH_INFO: `/v3/users/85b52ea58c594ae794b4c7c7b711bd44` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:06.831521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5317b-7223-40b6-9ba0-d5834d0f3527 None admin] RBAC: Authorizing `identity:get_user(user_id=85b52ea58c594ae794b4c7c7b711bd44)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:06.833457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d5317b-7223-40b6-9ba0-d5834d0f3527 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:06.837925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:06.844535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 149/288] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:06 2022] GET /identity/v3/users/85b52ea58c594ae794b4c7c7b711bd44 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:06.849566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5317b-7223-40b6-9ba0-d5834d0f3527 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:06.870876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c3263-0c22-4a6b-b3ad-7d573df78978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:06.872232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c3263-0c22-4a6b-b3ad-7d573df78978 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:06.873039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c3263-0c22-4a6b-b3ad-7d573df78978 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:06.873513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c3263-0c22-4a6b-b3ad-7d573df78978 None admin] PATH_INFO: `/v3/users/ab94e83a69444ff4963285ed35ccc06d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:06.875518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c3263-0c22-4a6b-b3ad-7d573df78978 None admin] RBAC: Authorizing `identity:get_user(user_id=ab94e83a69444ff4963285ed35ccc06d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:06.877855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c3263-0c22-4a6b-b3ad-7d573df78978 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:06.886031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 140/289] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:06 2022] GET /identity/v3/users/ab94e83a69444ff4963285ed35ccc06d => generated 297 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:06.888287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c3263-0c22-4a6b-b3ad-7d573df78978 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:06.983200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5317b-7223-40b6-9ba0-d5834d0f3527 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:07.027941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71009-3947-4f89-87f3-dbfbd070fe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:07.028924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71009-3947-4f89-87f3-dbfbd070fe86 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:07.030972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71009-3947-4f89-87f3-dbfbd070fe86 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:07.031450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea71009-3947-4f89-87f3-dbfbd070fe86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:07.078271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:07.130259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c3263-0c22-4a6b-b3ad-7d573df78978 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:07.149862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea71009-3947-4f89-87f3-dbfbd070fe86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:07.151653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea71009-3947-4f89-87f3-dbfbd070fe86 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:07.202612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c26a0-544f-49c0-8d70-58cf3eeab8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:07.203333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c26a0-544f-49c0-8d70-58cf3eeab8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:07.203627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c26a0-544f-49c0-8d70-58cf3eeab8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:07.203925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c26a0-544f-49c0-8d70-58cf3eeab8c9 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:07.205492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c26a0-544f-49c0-8d70-58cf3eeab8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:07.207440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c26a0-544f-49c0-8d70-58cf3eeab8c9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:07.213580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 141/290] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:06 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:07.214634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c26a0-544f-49c0-8d70-58cf3eeab8c9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:07.282219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:07.298600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 150/291] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:25:07.304776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71009-3947-4f89-87f3-dbfbd070fe86 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:07.342338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c26a0-544f-49c0-8d70-58cf3eeab8c9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:07.395952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40a5f-c78d-4bc9-a5eb-65a0110bda2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:07.396632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40a5f-c78d-4bc9-a5eb-65a0110bda2b None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:07.396920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40a5f-c78d-4bc9-a5eb-65a0110bda2b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:07.397199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f40a5f-c78d-4bc9-a5eb-65a0110bda2b None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/users/ab94e83a69444ff4963285ed35ccc06d/roles/1dc9ff2bc5034e32b66a5d9d3e388009` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:07.403632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f40a5f-c78d-4bc9-a5eb-65a0110bda2b None admin] RBAC: Authorizing `identity:create_grant(project_id=19bae8bf30dd4530b67b9f4d3bf46159, user_id=ab94e83a69444ff4963285ed35ccc06d, role_id=1dc9ff2bc5034e32b66a5d9d3e388009)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:07.404157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:07.405279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f40a5f-c78d-4bc9-a5eb-65a0110bda2b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:07.429939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 142/292] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:25:07 2022] PUT /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/users/ab94e83a69444ff4963285ed35ccc06d/roles/1dc9ff2bc5034e32b66a5d9d3e388009 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:25:07.469471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea71009-3947-4f89-87f3-dbfbd070fe86 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:07.522550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3638fccb-5c2b-4447-96b6-6c5cb0270cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:07.523214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fccb-5c2b-4447-96b6-6c5cb0270cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:07.523497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fccb-5c2b-4447-96b6-6c5cb0270cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:07.523861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638fccb-5c2b-4447-96b6-6c5cb0270cb0 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:07.528597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638fccb-5c2b-4447-96b6-6c5cb0270cb0 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:07.530415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3638fccb-5c2b-4447-96b6-6c5cb0270cb0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:07.533828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 151/293] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:07 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:07.541202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40a5f-c78d-4bc9-a5eb-65a0110bda2b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:07.682066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f40a5f-c78d-4bc9-a5eb-65a0110bda2b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:07.698434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:07.724522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698832c6-04f7-4aa9-b35c-a2d479fb849b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:07.725134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698832c6-04f7-4aa9-b35c-a2d479fb849b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:07.725415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698832c6-04f7-4aa9-b35c-a2d479fb849b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:07.725696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698832c6-04f7-4aa9-b35c-a2d479fb849b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:07.726508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698832c6-04f7-4aa9-b35c-a2d479fb849b None admin] RBAC: Adding query filter params (role.id=e104332d9de24bed8d32257cab931633, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159, user.id=85b52ea58c594ae794b4c7c7b711bd44) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:07.726822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698832c6-04f7-4aa9-b35c-a2d479fb849b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:07.728260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698832c6-04f7-4aa9-b35c-a2d479fb849b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:07.734705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 143/294] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:07 2022] GET /identity/v3/role_assignments?user.id=85b52ea58c594ae794b4c7c7b711bd44&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=e104332d9de24bed8d32257cab931633 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:08.051595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4d309-0ef1-4751-9cce-35f4951cfecb None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.052103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4d309-0ef1-4751-9cce-35f4951cfecb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.052178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4d309-0ef1-4751-9cce-35f4951cfecb None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.053773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 152/295] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:08.059711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4d05-b664-421a-8906-9d19a8a820f0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.060019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4d05-b664-421a-8906-9d19a8a820f0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.060272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d4d05-b664-421a-8906-9d19a8a820f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.079628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-820d4d05-b664-421a-8906-9d19a8a820f0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:08.081632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-820d4d05-b664-421a-8906-9d19a8a820f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:08.157998 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 144/296] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:08.220540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3d17d-6947-47ec-8fca-95d9184a9e5e None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.221357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3d17d-6947-47ec-8fca-95d9184a9e5e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.221624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b3d17d-6947-47ec-8fca-95d9184a9e5e None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.223272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 153/297] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:08.228665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1fb8e-bc8f-4c67-9107-5a5d0308a2cb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.228954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1fb8e-bc8f-4c67-9107-5a5d0308a2cb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.229233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1fb8e-bc8f-4c67-9107-5a5d0308a2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.248907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6ba1fb8e-bc8f-4c67-9107-5a5d0308a2cb None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:08.250107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6ba1fb8e-bc8f-4c67-9107-5a5d0308a2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:08.328886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 145/298] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:08.345505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251114e-6543-40ca-922a-7eda0fab6d2c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.345825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251114e-6543-40ca-922a-7eda0fab6d2c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.346293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251114e-6543-40ca-922a-7eda0fab6d2c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.348014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 154/299] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:08.353000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613cdee-636d-4e7c-b252-2910e7df0196 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.353286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613cdee-636d-4e7c-b252-2910e7df0196 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.353565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e613cdee-636d-4e7c-b252-2910e7df0196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.373410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e613cdee-636d-4e7c-b252-2910e7df0196 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:08.374611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e613cdee-636d-4e7c-b252-2910e7df0196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:08.404790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:08.445815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 146/300] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:08.469028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251114e-6543-40ca-922a-7eda0fab6d2c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:08.580661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251114e-6543-40ca-922a-7eda0fab6d2c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:08.597788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:08.616309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1edd4-e464-4638-bedd-84668174828d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:08.616992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1edd4-e464-4638-bedd-84668174828d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.617279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1edd4-e464-4638-bedd-84668174828d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.617553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1edd4-e464-4638-bedd-84668174828d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.629383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1edd4-e464-4638-bedd-84668174828d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:08.629528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613cdee-636d-4e7c-b252-2910e7df0196 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e3b1edd4-e464-4638-bedd-84668174828d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:08.634286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:08.635137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:08.635925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 155/301] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:08.641263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1edd4-e464-4638-bedd-84668174828d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:08.751626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1edd4-e464-4638-bedd-84668174828d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:08.764147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e613cdee-636d-4e7c-b252-2910e7df0196 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:08.792930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:08.793632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.793856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.794169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.794881 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:08.795195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:08.796639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:08.804064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f629-345a-434d-ab3d-4144eadbb8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:08.804710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f629-345a-434d-ab3d-4144eadbb8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.804996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f629-345a-434d-ab3d-4144eadbb8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.805272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a494f629-345a-434d-ab3d-4144eadbb8e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.808947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 156/302] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:08.814907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:08.818770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a494f629-345a-434d-ab3d-4144eadbb8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a494f629-345a-434d-ab3d-4144eadbb8e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:08.823627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:08.824485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 147/303] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:08.830054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f629-345a-434d-ab3d-4144eadbb8e9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:08.857592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:08.861113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:08.923203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17cfaa-01cb-4f3a-908f-e846fa3db5c3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:08.939872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a494f629-345a-434d-ab3d-4144eadbb8e9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:08.962641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981961-74fe-4ec8-aa96-15b2345b6cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:08.963278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981961-74fe-4ec8-aa96-15b2345b6cab None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.963564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981961-74fe-4ec8-aa96-15b2345b6cab None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.963838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981961-74fe-4ec8-aa96-15b2345b6cab None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.964959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c981961-74fe-4ec8-aa96-15b2345b6cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:08.966460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c981961-74fe-4ec8-aa96-15b2345b6cab None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:08.968029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 157/304] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:08.968809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981961-74fe-4ec8-aa96-15b2345b6cab None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:08.981982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc8775-0976-4a46-ad14-9d7c802a294c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:08.982619 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8775-0976-4a46-ad14-9d7c802a294c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:08.982905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8775-0976-4a46-ad14-9d7c802a294c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:08.983182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc8775-0976-4a46-ad14-9d7c802a294c None admin] PATH_INFO: `/v3/users/46a4030506cd4f4fb40105c80cf7084c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:08.997540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc8775-0976-4a46-ad14-9d7c802a294c None admin] RBAC: Authorizing `identity:get_user(user_id=46a4030506cd4f4fb40105c80cf7084c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:08.999091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bc8775-0976-4a46-ad14-9d7c802a294c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:09.000704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 148/305] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:08 2022] GET /identity/v3/users/46a4030506cd4f4fb40105c80cf7084c => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:09.002794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc8775-0976-4a46-ad14-9d7c802a294c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:09.079557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981961-74fe-4ec8-aa96-15b2345b6cab None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:09.088737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:09.095932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:09.117192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bc8775-0976-4a46-ad14-9d7c802a294c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:09.118711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:09.119327 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:09.119612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:09.119889 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:09.120560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:09.120862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:09.122301 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:09.133045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 158/306] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:09.138339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:09.158678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180a59-4978-40af-a3ae-a7c0480f7948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:09.159288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180a59-4978-40af-a3ae-a7c0480f7948 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:09.159567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180a59-4978-40af-a3ae-a7c0480f7948 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:09.159837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad180a59-4978-40af-a3ae-a7c0480f7948 None admin] PATH_INFO: `/v3/groups` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:09.160456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180a59-4978-40af-a3ae-a7c0480f7948 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:09.161913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad180a59-4978-40af-a3ae-a7c0480f7948 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:09.179036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 149/307] 10.222.0.88 () {60 vars in 1134 bytes} [Fri Aug 26 00:25:09 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:09.179770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180a59-4978-40af-a3ae-a7c0480f7948 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:09.288999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d576550-b493-498f-9932-7ecc5d203d97 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:09.320864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad180a59-4978-40af-a3ae-a7c0480f7948 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:09.331604 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:09.332218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:09.332497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:09.332766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:09.333493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] RBAC: Adding query filter params (role.id=1dc9ff2bc5034e32b66a5d9d3e388009, user.id=46a4030506cd4f4fb40105c80cf7084c, scope.system=all) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:09.333801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:09.336076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:09.341932 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 159/308] 10.222.0.88 () {56 vars in 1308 bytes} [Fri Aug 26 00:25:09 2022] GET /identity/v3/role_assignments?user.id=46a4030506cd4f4fb40105c80cf7084c&scope.system=all&role.id=1dc9ff2bc5034e32b66a5d9d3e388009 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:09.365753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782e03c-7949-4155-bc4f-b168fe0ad934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:09.366471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782e03c-7949-4155-bc4f-b168fe0ad934 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:09.366758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782e03c-7949-4155-bc4f-b168fe0ad934 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:09.367037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782e03c-7949-4155-bc4f-b168fe0ad934 None admin] PATH_INFO: `/v3/users/de084e30a744450bb75f5e0dc385d604` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:09.368332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782e03c-7949-4155-bc4f-b168fe0ad934 None admin] RBAC: Authorizing `identity:get_user(user_id=de084e30a744450bb75f5e0dc385d604)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:09.369759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782e03c-7949-4155-bc4f-b168fe0ad934 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:09.371643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 150/309] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:09 2022] GET /identity/v3/users/de084e30a744450bb75f5e0dc385d604 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:09.377941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:09.415962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:09.498255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a995d6-8b93-4690-ba10-c00264b7fe5d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:09.540364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338bb74-7ca5-4291-b1e3-2c8640366f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:09.541031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338bb74-7ca5-4291-b1e3-2c8640366f9c None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:09.541322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338bb74-7ca5-4291-b1e3-2c8640366f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:09.541602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338bb74-7ca5-4291-b1e3-2c8640366f9c None admin] PATH_INFO: `/v3/system/users/de084e30a744450bb75f5e0dc385d604/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:09.543082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338bb74-7ca5-4291-b1e3-2c8640366f9c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=de084e30a744450bb75f5e0dc385d604, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:09.544477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338bb74-7ca5-4291-b1e3-2c8640366f9c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:09.562129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 160/310] 10.222.0.88 () {58 vars in 1334 bytes} [Fri Aug 26 00:25:09 2022] PUT /identity/v3/system/users/de084e30a744450bb75f5e0dc385d604/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:09.675978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c93fb-f96f-4c5a-a481-002a5b04eb01 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:09.676488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c93fb-f96f-4c5a-a481-002a5b04eb01 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:09.676488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c93fb-f96f-4c5a-a481-002a5b04eb01 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:09.677979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 151/311] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:09.684004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6395e2-5af7-4be1-9fc0-f6e60ad53634 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:09.684689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6395e2-5af7-4be1-9fc0-f6e60ad53634 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:09.685176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6395e2-5af7-4be1-9fc0-f6e60ad53634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:09.707562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5d6395e2-5af7-4be1-9fc0-f6e60ad53634 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:09.708802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5d6395e2-5af7-4be1-9fc0-f6e60ad53634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:09.784317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 161/312] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:10.064936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c93fb-f96f-4c5a-a481-002a5b04eb01 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:10.081745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:10.175157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c93fb-f96f-4c5a-a481-002a5b04eb01 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:10.211666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d01f8-2074-4df3-9f9b-ae89b14f5473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:10.212747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d01f8-2074-4df3-9f9b-ae89b14f5473 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:10.213231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d01f8-2074-4df3-9f9b-ae89b14f5473 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:10.213706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d01f8-2074-4df3-9f9b-ae89b14f5473 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:10.226367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d01f8-2074-4df3-9f9b-ae89b14f5473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-497d01f8-2074-4df3-9f9b-ae89b14f5473 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:10.231807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:10.232801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:10.233621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:10.236295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 152/313] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:10.242986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6395e2-5af7-4be1-9fc0-f6e60ad53634 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:10.274605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:10.353981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6395e2-5af7-4be1-9fc0-f6e60ad53634 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:10.390642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:10.391253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:10.391534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:10.391807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:10.392486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:10.393524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:10.395115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:10.404602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 162/314] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:10.410494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d01f8-2074-4df3-9f9b-ae89b14f5473 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:10.493550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:10.525666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d01f8-2074-4df3-9f9b-ae89b14f5473 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:10.575712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77fa2-f6fc-4a1d-af76-b87f8e2655aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:10.576384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77fa2-f6fc-4a1d-af76-b87f8e2655aa None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:10.576672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77fa2-f6fc-4a1d-af76-b87f8e2655aa None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:10.576955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a77fa2-f6fc-4a1d-af76-b87f8e2655aa None admin] PATH_INFO: `/v3/users/ab94e83a69444ff4963285ed35ccc06d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:10.578152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a77fa2-f6fc-4a1d-af76-b87f8e2655aa None admin] RBAC: Authorizing `identity:get_user(user_id=ab94e83a69444ff4963285ed35ccc06d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:10.579612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a77fa2-f6fc-4a1d-af76-b87f8e2655aa None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:10.586140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 153/315] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:10 2022] GET /identity/v3/users/ab94e83a69444ff4963285ed35ccc06d => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:10.587806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:10.685286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:10.699555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b94d9c9-96f3-49a0-a1c2-c578543de964 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:10.740274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42975e-db62-4f5f-8a43-6139eeaa9cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:10.740890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42975e-db62-4f5f-8a43-6139eeaa9cbb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:10.741169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42975e-db62-4f5f-8a43-6139eeaa9cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:10.741442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e42975e-db62-4f5f-8a43-6139eeaa9cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:10.811123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42975e-db62-4f5f-8a43-6139eeaa9cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:10.812616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e42975e-db62-4f5f-8a43-6139eeaa9cbb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:10.905744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:10.928181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 163/316] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:10.934029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77fa2-f6fc-4a1d-af76-b87f8e2655aa None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:11.044150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a77fa2-f6fc-4a1d-af76-b87f8e2655aa None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:11.081736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c88f4d-7599-4a89-ba59-2ea2cb5495b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:11.082411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88f4d-7599-4a89-ba59-2ea2cb5495b0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.082700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88f4d-7599-4a89-ba59-2ea2cb5495b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.082979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c88f4d-7599-4a89-ba59-2ea2cb5495b0 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.084120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c88f4d-7599-4a89-ba59-2ea2cb5495b0 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:11.086132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c88f4d-7599-4a89-ba59-2ea2cb5495b0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:11.088092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 154/317] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:10 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:11.093992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42975e-db62-4f5f-8a43-6139eeaa9cbb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:11.205161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e42975e-db62-4f5f-8a43-6139eeaa9cbb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:11.240571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c8cede-c9dd-4204-ac69-a34352a653cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:11.241174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8cede-c9dd-4204-ac69-a34352a653cb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.241451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8cede-c9dd-4204-ac69-a34352a653cb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.241722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c8cede-c9dd-4204-ac69-a34352a653cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.242475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8cede-c9dd-4204-ac69-a34352a653cb None admin] RBAC: Adding query filter params (role.id=1dc9ff2bc5034e32b66a5d9d3e388009, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159, user.id=ab94e83a69444ff4963285ed35ccc06d) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:11.242784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8cede-c9dd-4204-ac69-a34352a653cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:11.244234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c8cede-c9dd-4204-ac69-a34352a653cb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:11.250448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 164/318] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:11 2022] GET /identity/v3/role_assignments?user.id=ab94e83a69444ff4963285ed35ccc06d&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=1dc9ff2bc5034e32b66a5d9d3e388009 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:11.323637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b55115-4377-40da-95eb-5362d8830d20 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.324249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b55115-4377-40da-95eb-5362d8830d20 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.324745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b55115-4377-40da-95eb-5362d8830d20 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.326698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 155/319] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:11.332888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ec82-d020-4bfb-a046-860880ac0b50 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.333212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ec82-d020-4bfb-a046-860880ac0b50 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.333445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0ec82-d020-4bfb-a046-860880ac0b50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.352843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1aa0ec82-d020-4bfb-a046-860880ac0b50 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:11.354090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1aa0ec82-d020-4bfb-a046-860880ac0b50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:11.363494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f0ca-b0c7-48b1-a83d-d41476a915dd None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.364133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f0ca-b0c7-48b1-a83d-d41476a915dd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.364610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c3f0ca-b0c7-48b1-a83d-d41476a915dd None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.366570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 156/320] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:25:11.372420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3c41-e700-42ba-932b-fdf9faff7e22 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.373009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3c41-e700-42ba-932b-fdf9faff7e22 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.373499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c3c41-e700-42ba-932b-fdf9faff7e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.395102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4a6c3c41-e700-42ba-932b-fdf9faff7e22 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:11.396296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a6c3c41-e700-42ba-932b-fdf9faff7e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:11.399170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:11.419861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:11.449803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 165/321] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:11.485060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 157/322] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:11.525203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca40d4-0a58-4d71-abd4-8c412d6aa7dd None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.525490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca40d4-0a58-4d71-abd4-8c412d6aa7dd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.525770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ca40d4-0a58-4d71-abd4-8c412d6aa7dd None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.527416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 166/323] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:11.532762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9845ea-2d9e-4b78-8be1-ee502b674610 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.533061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9845ea-2d9e-4b78-8be1-ee502b674610 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.534321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9845ea-2d9e-4b78-8be1-ee502b674610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.556413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5e9845ea-2d9e-4b78-8be1-ee502b674610 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:11.557611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5e9845ea-2d9e-4b78-8be1-ee502b674610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:11.630892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 158/324] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:11.728393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca40d4-0a58-4d71-abd4-8c412d6aa7dd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:11.763397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9845ea-2d9e-4b78-8be1-ee502b674610 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:11.840197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ca40d4-0a58-4d71-abd4-8c412d6aa7dd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:11.842293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:11.875853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c89ae-c0d8-43f6-a9c2-58bc702874d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:11.876654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c89ae-c0d8-43f6-a9c2-58bc702874d3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.877580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c89ae-c0d8-43f6-a9c2-58bc702874d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.878051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c89ae-c0d8-43f6-a9c2-58bc702874d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.879170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c89ae-c0d8-43f6-a9c2-58bc702874d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:11.879970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9845ea-2d9e-4b78-8be1-ee502b674610 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:11.880621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c89ae-c0d8-43f6-a9c2-58bc702874d3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:11.882541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 167/325] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:11.887493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c89ae-c0d8-43f6-a9c2-58bc702874d3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:11.920063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33897-0272-410a-ae6e-8a1eeb2ce1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:11.920698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33897-0272-410a-ae6e-8a1eeb2ce1bf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:11.920986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33897-0272-410a-ae6e-8a1eeb2ce1bf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:11.921259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33897-0272-410a-ae6e-8a1eeb2ce1bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:11.931554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da33897-0272-410a-ae6e-8a1eeb2ce1bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2da33897-0272-410a-ae6e-8a1eeb2ce1bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:11.936325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:11.937718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:11.939255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:11.940594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:11.942889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 159/326] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:11.943635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33897-0272-410a-ae6e-8a1eeb2ce1bf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:11.988070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c89ae-c0d8-43f6-a9c2-58bc702874d3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:12.022363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b97f8b-1342-49a7-8c99-d7e6bbd6c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:12.022966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b97f8b-1342-49a7-8c99-d7e6bbd6c6ba None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:12.023251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b97f8b-1342-49a7-8c99-d7e6bbd6c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:12.023525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b97f8b-1342-49a7-8c99-d7e6bbd6c6ba None admin] PATH_INFO: `/v3/groups` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:12.024140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b97f8b-1342-49a7-8c99-d7e6bbd6c6ba None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:12.025579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b97f8b-1342-49a7-8c99-d7e6bbd6c6ba None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:12.041994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 168/327] 10.222.0.88 () {60 vars in 1134 bytes} [Fri Aug 26 00:25:11 2022] POST /identity/v3/groups => generated 226 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:25:12.042822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b97f8b-1342-49a7-8c99-d7e6bbd6c6ba None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:12.043152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33897-0272-410a-ae6e-8a1eeb2ce1bf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:12.075863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:12.086795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7aa77d-6f21-4b92-8568-7e288bc46fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:12.087460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aa77d-6f21-4b92-8568-7e288bc46fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:12.087809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aa77d-6f21-4b92-8568-7e288bc46fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:12.088201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7aa77d-6f21-4b92-8568-7e288bc46fb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:12.101186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7aa77d-6f21-4b92-8568-7e288bc46fb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7b7aa77d-6f21-4b92-8568-7e288bc46fb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:12.106617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:12.107680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:12.108441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 160/328] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:12.114620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7aa77d-6f21-4b92-8568-7e288bc46fb8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:12.175511 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b97f8b-1342-49a7-8c99-d7e6bbd6c6ba None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:12.187479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:12.224983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:12.225609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:12.225942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:12.226224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:12.226901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:12.227209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:12.228611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:12.233760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7aa77d-6f21-4b92-8568-7e288bc46fb8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:12.243931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 169/329] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:12.245460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:12.277309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:12.278321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:12.279695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:12.279695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:12.279695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:12.279942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:12.281177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:12.291809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 161/330] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:12.301435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:12.371689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abde0826-4355-417f-a2de-81add1eec140 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:12.375836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:12.416037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc56a5-805e-4bcc-add9-8f9d81c17280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:12.416836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc56a5-805e-4bcc-add9-8f9d81c17280 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:12.417258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc56a5-805e-4bcc-add9-8f9d81c17280 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:12.417639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc56a5-805e-4bcc-add9-8f9d81c17280 None admin] PATH_INFO: `/v3/users/46a4030506cd4f4fb40105c80cf7084c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:12.419039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc56a5-805e-4bcc-add9-8f9d81c17280 None admin] RBAC: Authorizing `identity:get_user(user_id=46a4030506cd4f4fb40105c80cf7084c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:12.420763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc56a5-805e-4bcc-add9-8f9d81c17280 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:12.423636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 170/331] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:12 2022] GET /identity/v3/users/46a4030506cd4f4fb40105c80cf7084c => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:12.431482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc56a5-805e-4bcc-add9-8f9d81c17280 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:12.433574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e536b329-5ee3-4893-a5a8-9baa292847d6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:12.476242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96418c9-df40-41fd-9b0a-b5772913b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:12.476242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96418c9-df40-41fd-9b0a-b5772913b217 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:12.476518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96418c9-df40-41fd-9b0a-b5772913b217 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:12.476695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96418c9-df40-41fd-9b0a-b5772913b217 None admin] PATH_INFO: `/v3/users/de084e30a744450bb75f5e0dc385d604` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:12.477988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96418c9-df40-41fd-9b0a-b5772913b217 None admin] RBAC: Authorizing `identity:get_user(user_id=de084e30a744450bb75f5e0dc385d604)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:12.479560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96418c9-df40-41fd-9b0a-b5772913b217 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:12.481806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 162/332] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:12 2022] GET /identity/v3/users/de084e30a744450bb75f5e0dc385d604 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:12.487121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:12.492398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96418c9-df40-41fd-9b0a-b5772913b217 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:12.592227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc56a5-805e-4bcc-add9-8f9d81c17280 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:12.623817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96418c9-df40-41fd-9b0a-b5772913b217 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:12.647952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:12.668556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72387639-1893-436e-9c4f-661b922e5362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:12.669437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387639-1893-436e-9c4f-661b922e5362 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:12.669718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387639-1893-436e-9c4f-661b922e5362 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:12.670037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72387639-1893-436e-9c4f-661b922e5362 None admin] PATH_INFO: `/v3/system/users/46a4030506cd4f4fb40105c80cf7084c/roles/1dc9ff2bc5034e32b66a5d9d3e388009` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:12.670268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36a571a-8c7f-4145-8145-a10370ae1e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:12.670882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a571a-8c7f-4145-8145-a10370ae1e90 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:12.671169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a571a-8c7f-4145-8145-a10370ae1e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:12.671449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36a571a-8c7f-4145-8145-a10370ae1e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:12.671568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72387639-1893-436e-9c4f-661b922e5362 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=46a4030506cd4f4fb40105c80cf7084c, role_id=1dc9ff2bc5034e32b66a5d9d3e388009)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:12.672182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a571a-8c7f-4145-8145-a10370ae1e90 None admin] RBAC: Adding query filter params (role.id=e104332d9de24bed8d32257cab931633, user.id=de084e30a744450bb75f5e0dc385d604, scope.system=all) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:12.672493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a571a-8c7f-4145-8145-a10370ae1e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:12.672853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72387639-1893-436e-9c4f-661b922e5362 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:12.674543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36a571a-8c7f-4145-8145-a10370ae1e90 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:12.688139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 171/333] 10.222.0.88 () {58 vars in 1334 bytes} [Fri Aug 26 00:25:12 2022] PUT /identity/v3/system/users/46a4030506cd4f4fb40105c80cf7084c/roles/1dc9ff2bc5034e32b66a5d9d3e388009 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:25:12.697047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 163/334] 10.222.0.88 () {56 vars in 1308 bytes} [Fri Aug 26 00:25:12 2022] GET /identity/v3/role_assignments?user.id=de084e30a744450bb75f5e0dc385d604&scope.system=all&role.id=e104332d9de24bed8d32257cab931633 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:14.271920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509504-b385-4e20-b759-d6a04d9e2316 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:14.272656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509504-b385-4e20-b759-d6a04d9e2316 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:14.272656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d509504-b385-4e20-b759-d6a04d9e2316 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:14.274072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 172/335] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:14.282864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6f8a-1074-452e-a9d4-d42cccabab75 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:14.284173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6f8a-1074-452e-a9d4-d42cccabab75 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:14.284173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c6f8a-1074-452e-a9d4-d42cccabab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:14.306871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-569c6f8a-1074-452e-a9d4-d42cccabab75 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:14.308083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-569c6f8a-1074-452e-a9d4-d42cccabab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:14.396086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 164/336] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:14.836614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763468-77a0-4cd8-bea6-4b3e99739ed4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:14.836953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763468-77a0-4cd8-bea6-4b3e99739ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:14.837122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10763468-77a0-4cd8-bea6-4b3e99739ed4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:14.838436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 173/337] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:14.844434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4ae30-ba26-4c60-9fc9-fd06f31ab89f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:14.844721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4ae30-ba26-4c60-9fc9-fd06f31ab89f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:14.844992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4ae30-ba26-4c60-9fc9-fd06f31ab89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:14.849616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763468-77a0-4cd8-bea6-4b3e99739ed4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:14.877449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9ac4ae30-ba26-4c60-9fc9-fd06f31ab89f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:14.879023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9ac4ae30-ba26-4c60-9fc9-fd06f31ab89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:14.980681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 165/338] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:15.011984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10763468-77a0-4cd8-bea6-4b3e99739ed4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:15.014856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:15.062242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e615e-af16-4bc1-92fb-a73aabff9f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:15.063271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e615e-af16-4bc1-92fb-a73aabff9f4f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.063794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e615e-af16-4bc1-92fb-a73aabff9f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.064337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e615e-af16-4bc1-92fb-a73aabff9f4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.087075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1e615e-af16-4bc1-92fb-a73aabff9f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-8e1e615e-af16-4bc1-92fb-a73aabff9f4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:15.092430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:15.093400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:15.094200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:15.098528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 174/339] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:15.103649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4ae30-ba26-4c60-9fc9-fd06f31ab89f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:15.143115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:15.225692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac4ae30-ba26-4c60-9fc9-fd06f31ab89f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:15.265530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f1974-d5b8-4d3a-9655-b11883b8290f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.266258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f1974-d5b8-4d3a-9655-b11883b8290f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.266772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8f1974-d5b8-4d3a-9655-b11883b8290f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.267096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:15.267949 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.268332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.268625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.269304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:15.269630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:15.270035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 175/340] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:15.272573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:15.275690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235a33-9c8d-429e-8560-873aaac1d828 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.276922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235a33-9c8d-429e-8560-873aaac1d828 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.277398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235a33-9c8d-429e-8560-873aaac1d828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.284352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 166/341] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:15.293938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:15.319127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1e235a33-9c8d-429e-8560-873aaac1d828 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:15.321572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1e235a33-9c8d-429e-8560-873aaac1d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:15.426685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 176/342] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:15.461925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:15.468871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd9954-0a4d-4f36-9f1c-b22530cb86a7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:15.518617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96f183-fdbd-411e-88b6-cb4580ccdb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:15.519509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f183-fdbd-411e-88b6-cb4580ccdb56 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.519941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f183-fdbd-411e-88b6-cb4580ccdb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.520359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96f183-fdbd-411e-88b6-cb4580ccdb56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.552626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338b91-53c2-4069-9f74-713c83af8ee8 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.552936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338b91-53c2-4069-9f74-713c83af8ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.553219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1338b91-53c2-4069-9f74-713c83af8ee8 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.566216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 177/343] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:15 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:25:15.576799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ad2c-ff6a-47cd-a029-d85671ddcfe5 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.577249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ad2c-ff6a-47cd-a029-d85671ddcfe5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.577669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21ad2c-ff6a-47cd-a029-d85671ddcfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.609110 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96f183-fdbd-411e-88b6-cb4580ccdb56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:15.610653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d96f183-fdbd-411e-88b6-cb4580ccdb56 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:15.612393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dd21ad2c-ff6a-47cd-a029-d85671ddcfe5 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:15.618203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dd21ad2c-ff6a-47cd-a029-d85671ddcfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:15.719233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 178/344] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:15.720477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21ad2c-ff6a-47cd-a029-d85671ddcfe5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:15.731109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:15.741586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 167/345] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:15.747743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96f183-fdbd-411e-88b6-cb4580ccdb56 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:15.752531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:15.841073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21ad2c-ff6a-47cd-a029-d85671ddcfe5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:15.880505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bcbd-ca3d-4e5c-aaba-68d0905b9d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:15.881328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bcbd-ca3d-4e5c-aaba-68d0905b9d40 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.881710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bcbd-ca3d-4e5c-aaba-68d0905b9d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.882120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145bcbd-ca3d-4e5c-aaba-68d0905b9d40 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.895864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145bcbd-ca3d-4e5c-aaba-68d0905b9d40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:15.898241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96f183-fdbd-411e-88b6-cb4580ccdb56 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f145bcbd-ca3d-4e5c-aaba-68d0905b9d40 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:15.901315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:15.902337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:15.903835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 179/346] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:25:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:15.904482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bcbd-ca3d-4e5c-aaba-68d0905b9d40 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:15.951505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63ebb1-20a2-4647-8e8f-63b690fb6b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:15.952531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ebb1-20a2-4647-8e8f-63b690fb6b49 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:15.953016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ebb1-20a2-4647-8e8f-63b690fb6b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:15.953491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da63ebb1-20a2-4647-8e8f-63b690fb6b49 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:15.958595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63ebb1-20a2-4647-8e8f-63b690fb6b49 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:15.960318 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da63ebb1-20a2-4647-8e8f-63b690fb6b49 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:15.962608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 168/347] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:15 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:15.963656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63ebb1-20a2-4647-8e8f-63b690fb6b49 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:16.026379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:16.030565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145bcbd-ca3d-4e5c-aaba-68d0905b9d40 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:16.070478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:16.076521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255640-9286-4752-9097-ddb26e10345f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:16.077174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255640-9286-4752-9097-ddb26e10345f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.077457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255640-9286-4752-9097-ddb26e10345f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.077732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255640-9286-4752-9097-ddb26e10345f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.090094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90255640-9286-4752-9097-ddb26e10345f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-90255640-9286-4752-9097-ddb26e10345f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:16.095135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:16.096794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:16.097586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 180/348] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:16.098730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255640-9286-4752-9097-ddb26e10345f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:16.131485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da63ebb1-20a2-4647-8e8f-63b690fb6b49 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:16.187505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:16.188136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.188421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.188702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.190124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:16.190644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:16.192044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:16.209160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 169/349] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:16.211663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:16.215649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255640-9286-4752-9097-ddb26e10345f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:16.257853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc5b4-b2c4-4397-bbd8-bba443b39437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:16.258517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc5b4-b2c4-4397-bbd8-bba443b39437 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.258802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc5b4-b2c4-4397-bbd8-bba443b39437 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.259080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc5b4-b2c4-4397-bbd8-bba443b39437 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.265870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efc5b4-b2c4-4397-bbd8-bba443b39437 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:16.268251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efc5b4-b2c4-4397-bbd8-bba443b39437 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:16.270293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 181/350] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:16 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:16.271089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc5b4-b2c4-4397-bbd8-bba443b39437 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:16.286405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:16.394238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c0c7f-2db5-48ef-acba-57c6558e2111 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:16.395527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc5b4-b2c4-4397-bbd8-bba443b39437 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:16.430232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:16.437025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10dba7-fd74-4daa-b2ef-c29b084c55a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:16.440364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10dba7-fd74-4daa-b2ef-c29b084c55a8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.440364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10dba7-fd74-4daa-b2ef-c29b084c55a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.440364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10dba7-fd74-4daa-b2ef-c29b084c55a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.444710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:16.445613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.446142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.446610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.447476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] RBAC: Adding query filter params (name=reader) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:16.447970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:16.449510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:16.460242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 170/351] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:16.465548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:16.518216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10dba7-fd74-4daa-b2ef-c29b084c55a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:16.519866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c10dba7-fd74-4daa-b2ef-c29b084c55a8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:16.530835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:16.601149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e7cea-03fd-4532-b105-e59306151fff None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:16.646061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4e558-5833-477d-8e82-8aebec3fdac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:16.646689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4e558-5833-477d-8e82-8aebec3fdac9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.646975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4e558-5833-477d-8e82-8aebec3fdac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.647256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4e558-5833-477d-8e82-8aebec3fdac9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.648006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4e558-5833-477d-8e82-8aebec3fdac9 None admin] RBAC: Adding query filter params (group.id=1a96bd7d940745a39ff55d7e8681bc67, role.id=e104332d9de24bed8d32257cab931633, scope.project.id=0984058b3d114dee94ef957c8703fd0a) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:16.648319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4e558-5833-477d-8e82-8aebec3fdac9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:16.649776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4e558-5833-477d-8e82-8aebec3fdac9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:16.654541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 182/352] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:16.656903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 171/353] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:16 2022] GET /identity/v3/role_assignments?group.id=1a96bd7d940745a39ff55d7e8681bc67&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=e104332d9de24bed8d32257cab931633 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:16.658244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10dba7-fd74-4daa-b2ef-c29b084c55a8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:16.660811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bc6c-3dd1-40a0-a3b5-c90c490ac7ab None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.661107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bc6c-3dd1-40a0-a3b5-c90c490ac7ab None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.661389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688bc6c-3dd1-40a0-a3b5-c90c490ac7ab None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.666653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 172/354] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:16.667525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688bc6c-3dd1-40a0-a3b5-c90c490ac7ab None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:16.743090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:16.806281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8688bc6c-3dd1-40a0-a3b5-c90c490ac7ab None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:16.809763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10dba7-fd74-4daa-b2ef-c29b084c55a8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:16.835888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:16.853907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd4d1-3188-49ac-8d51-bcf1122aa1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:16.854722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd4d1-3188-49ac-8d51-bcf1122aa1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.855009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd4d1-3188-49ac-8d51-bcf1122aa1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.855290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd4d1-3188-49ac-8d51-bcf1122aa1e4 None admin] PATH_INFO: `/v3/users/46a4030506cd4f4fb40105c80cf7084c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.856430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd4d1-3188-49ac-8d51-bcf1122aa1e4 None admin] RBAC: Authorizing `identity:get_user(user_id=46a4030506cd4f4fb40105c80cf7084c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:16.857939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd4d1-3188-49ac-8d51-bcf1122aa1e4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:16.859370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25b08b-4850-4424-b1ea-fc15d27ba888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:16.859576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 173/355] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:25:16 2022] GET /identity/v3/users/46a4030506cd4f4fb40105c80cf7084c => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:16.860234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b08b-4850-4424-b1ea-fc15d27ba888 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.860335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd4d1-3188-49ac-8d51-bcf1122aa1e4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:16.860565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b08b-4850-4424-b1ea-fc15d27ba888 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.860952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25b08b-4850-4424-b1ea-fc15d27ba888 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.873940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25b08b-4850-4424-b1ea-fc15d27ba888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1d25b08b-4850-4424-b1ea-fc15d27ba888 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:16.880284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:16.881156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:16.881929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:16.886019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 183/356] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:16.887618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de00e2-2e5f-4c12-8215-b09f5f128d3a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:16.887922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de00e2-2e5f-4c12-8215-b09f5f128d3a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:16.888231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92de00e2-2e5f-4c12-8215-b09f5f128d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:16.910136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-92de00e2-2e5f-4c12-8215-b09f5f128d3a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:16.911468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-92de00e2-2e5f-4c12-8215-b09f5f128d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:16.975820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd4d1-3188-49ac-8d51-bcf1122aa1e4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:17.003038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 184/357] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:17.010286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:17.011915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de00e2-2e5f-4c12-8215-b09f5f128d3a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:17.022306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0cb2b-c0a7-41f6-966e-df71a3595481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:17.023267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0cb2b-c0a7-41f6-966e-df71a3595481 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.023770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0cb2b-c0a7-41f6-966e-df71a3595481 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.024245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0cb2b-c0a7-41f6-966e-df71a3595481 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.026261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0cb2b-c0a7-41f6-966e-df71a3595481 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:17.027936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0cb2b-c0a7-41f6-966e-df71a3595481 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:17.031058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 174/358] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:16 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:17.032274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0cb2b-c0a7-41f6-966e-df71a3595481 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:17.136693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:17.140789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92de00e2-2e5f-4c12-8215-b09f5f128d3a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:17.177802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0cb2b-c0a7-41f6-966e-df71a3595481 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:17.192661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d53a05-841e-4a79-81fa-ac3b024c3928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:17.193822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53a05-841e-4a79-81fa-ac3b024c3928 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.194306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53a05-841e-4a79-81fa-ac3b024c3928 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.195219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d53a05-841e-4a79-81fa-ac3b024c3928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.196135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d53a05-841e-4a79-81fa-ac3b024c3928 None admin] RBAC: Adding query filter params (role.id=1dc9ff2bc5034e32b66a5d9d3e388009, user.id=46a4030506cd4f4fb40105c80cf7084c, scope.system=all) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:17.196917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d53a05-841e-4a79-81fa-ac3b024c3928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:17.198816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d53a05-841e-4a79-81fa-ac3b024c3928 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:17.217279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 185/359] 10.222.0.88 () {56 vars in 1308 bytes} [Fri Aug 26 00:25:17 2022] GET /identity/v3/role_assignments?user.id=46a4030506cd4f4fb40105c80cf7084c&scope.system=all&role.id=1dc9ff2bc5034e32b66a5d9d3e388009 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:17.219333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c1d5b-6f4a-4f20-9fca-92fdef5d7e6b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.219832 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c1d5b-6f4a-4f20-9fca-92fdef5d7e6b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.220337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c1d5b-6f4a-4f20-9fca-92fdef5d7e6b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.222324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 186/360] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:17.223326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c1d5b-6f4a-4f20-9fca-92fdef5d7e6b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:17.253839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe40dab-5e36-408f-b99d-e98a81fa2820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:17.255941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40dab-5e36-408f-b99d-e98a81fa2820 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.257307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40dab-5e36-408f-b99d-e98a81fa2820 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.258006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe40dab-5e36-408f-b99d-e98a81fa2820 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.260443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe40dab-5e36-408f-b99d-e98a81fa2820 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:17.261184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe40dab-5e36-408f-b99d-e98a81fa2820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:17.263697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe40dab-5e36-408f-b99d-e98a81fa2820 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:17.285194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 175/361] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:17.287111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ea78-fc9d-48be-8fd5-93e7efc7470e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.288596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ea78-fc9d-48be-8fd5-93e7efc7470e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.289819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6ea78-fc9d-48be-8fd5-93e7efc7470e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.324424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3df6ea78-fc9d-48be-8fd5-93e7efc7470e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:17.327395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3df6ea78-fc9d-48be-8fd5-93e7efc7470e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:17.395994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:17.399284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c1d5b-6f4a-4f20-9fca-92fdef5d7e6b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:17.420535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 176/362] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:17.421537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ea78-fc9d-48be-8fd5-93e7efc7470e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:17.443560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5969a3-2cba-4a2b-937f-a86f486ecfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:17.444602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5969a3-2cba-4a2b-937f-a86f486ecfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.445048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5969a3-2cba-4a2b-937f-a86f486ecfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.445479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5969a3-2cba-4a2b-937f-a86f486ecfe2 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.446839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5969a3-2cba-4a2b-937f-a86f486ecfe2 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:17.448585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5969a3-2cba-4a2b-937f-a86f486ecfe2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:17.450772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 187/363] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:17 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:17.451980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5969a3-2cba-4a2b-937f-a86f486ecfe2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:17.484678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:17.567668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6ea78-fc9d-48be-8fd5-93e7efc7470e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:17.608583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5969a3-2cba-4a2b-937f-a86f486ecfe2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:17.620407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a986bf2-0901-4f94-91c3-a8ff4a9fe61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:17.621099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a986bf2-0901-4f94-91c3-a8ff4a9fe61e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.621434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a986bf2-0901-4f94-91c3-a8ff4a9fe61e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.621770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a986bf2-0901-4f94-91c3-a8ff4a9fe61e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.665528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a227-73c9-4556-8cc9-a1f7521947dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:17.666636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a227-73c9-4556-8cc9-a1f7521947dc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.667118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a227-73c9-4556-8cc9-a1f7521947dc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.667586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f45a227-73c9-4556-8cc9-a1f7521947dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.682799 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:17.683907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f45a227-73c9-4556-8cc9-a1f7521947dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6f45a227-73c9-4556-8cc9-a1f7521947dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:17.691769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:17.692678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:17.693462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:17.695788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 188/364] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:25:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:17.699450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a227-73c9-4556-8cc9-a1f7521947dc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:17.722617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a986bf2-0901-4f94-91c3-a8ff4a9fe61e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:17.724939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a986bf2-0901-4f94-91c3-a8ff4a9fe61e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:17.811747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:17.833713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f45a227-73c9-4556-8cc9-a1f7521947dc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:17.848109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 177/365] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:17.848969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a986bf2-0901-4f94-91c3-a8ff4a9fe61e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:17.877040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:17.878253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:17.878771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:17.879285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:17.880390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] RBAC: Adding query filter params (group.id=1a96bd7d940745a39ff55d7e8681bc67, role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=0984058b3d114dee94ef957c8703fd0a) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:17.881193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:17.883315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:17.891782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 189/366] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:17 2022] GET /identity/v3/role_assignments?group.id=1a96bd7d940745a39ff55d7e8681bc67&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:17.893024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:17.950585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:17.978609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a986bf2-0901-4f94-91c3-a8ff4a9fe61e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.029575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:18.030623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:18.030908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:18.031182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:18.032156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:18.032464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:18.034731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:18.042183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07faf2a-209c-4199-bc1d-0cb68dcb508d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.051334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 178/367] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:18.052267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:18.127653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061ef2-5732-4a46-bb97-3c23c69dedc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:18.128768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061ef2-5732-4a46-bb97-3c23c69dedc9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:18.129063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061ef2-5732-4a46-bb97-3c23c69dedc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:18.129386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061ef2-5732-4a46-bb97-3c23c69dedc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:18.146368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e061ef2-5732-4a46-bb97-3c23c69dedc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-3e061ef2-5732-4a46-bb97-3c23c69dedc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:18.153907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:18.154773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 190/368] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:25:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:18.156145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061ef2-5732-4a46-bb97-3c23c69dedc9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:18.176625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:18.204419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ca3eb-8770-4cfa-a69a-0b6c079c0353 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.252070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a59b7-6f06-40ac-9231-45568ff20fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:18.253298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a59b7-6f06-40ac-9231-45568ff20fbf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:18.253802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a59b7-6f06-40ac-9231-45568ff20fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:18.254325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9a59b7-6f06-40ac-9231-45568ff20fbf None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:18.255753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a59b7-6f06-40ac-9231-45568ff20fbf None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:18.257447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9a59b7-6f06-40ac-9231-45568ff20fbf None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:18.263453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 179/369] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:18 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:18.264526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a59b7-6f06-40ac-9231-45568ff20fbf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:18.283059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:18.303797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061ef2-5732-4a46-bb97-3c23c69dedc9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.351775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449bbd-6392-4373-b6c0-849860ba2f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:18.351974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449bbd-6392-4373-b6c0-849860ba2f6d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:18.352265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449bbd-6392-4373-b6c0-849860ba2f6d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:18.352546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f449bbd-6392-4373-b6c0-849860ba2f6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:18.389225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9a59b7-6f06-40ac-9231-45568ff20fbf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.427936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:18.429322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:18.429820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:18.430320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:18.431478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:18.431972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:18.433687 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:18.444573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 180/370] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:18.445821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:18.446881 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449bbd-6392-4373-b6c0-849860ba2f6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:18.448337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f449bbd-6392-4373-b6c0-849860ba2f6d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:18.461386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:18.546436 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:18.588060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9c9e36-a3da-4a02-8ee7-c4e8f011aab3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.608713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 191/371] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:18.609967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449bbd-6392-4373-b6c0-849860ba2f6d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:18.639544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd032b-f36d-4b39-9894-2c44e3b6826f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:18.640193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd032b-f36d-4b39-9894-2c44e3b6826f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:18.640475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd032b-f36d-4b39-9894-2c44e3b6826f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:18.640824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd032b-f36d-4b39-9894-2c44e3b6826f None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:18.641912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd032b-f36d-4b39-9894-2c44e3b6826f None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:18.644332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd032b-f36d-4b39-9894-2c44e3b6826f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:18.648373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 181/372] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:18 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:18.648373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd032b-f36d-4b39-9894-2c44e3b6826f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:18.727045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f449bbd-6392-4373-b6c0-849860ba2f6d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.737678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:18.764162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e638d8c-ef49-4fde-944d-ac98508438b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:18.764776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638d8c-ef49-4fde-944d-ac98508438b9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:18.765054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638d8c-ef49-4fde-944d-ac98508438b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:18.765325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e638d8c-ef49-4fde-944d-ac98508438b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:18.774818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd032b-f36d-4b39-9894-2c44e3b6826f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.813512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c829b-fd9e-4295-9346-161defb7205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:18.815348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c829b-fd9e-4295-9346-161defb7205b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:18.815871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c829b-fd9e-4295-9346-161defb7205b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:18.816361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14c829b-fd9e-4295-9346-161defb7205b None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:18.817844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c829b-fd9e-4295-9346-161defb7205b None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:18.819594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14c829b-fd9e-4295-9346-161defb7205b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:18.821946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 182/373] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:18 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:18.822966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c829b-fd9e-4295-9346-161defb7205b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:18.837554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:18.842129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e638d8c-ef49-4fde-944d-ac98508438b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:18.843522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e638d8c-ef49-4fde-944d-ac98508438b9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:18.949196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14c829b-fd9e-4295-9346-161defb7205b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:18.963404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 192/374] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:18.964560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e638d8c-ef49-4fde-944d-ac98508438b9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:18.975473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:19.000714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8a478-9f63-4e96-80fb-1d80786c0912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:19.001290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a478-9f63-4e96-80fb-1d80786c0912 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.001601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a478-9f63-4e96-80fb-1d80786c0912 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.002764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8a478-9f63-4e96-80fb-1d80786c0912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.003234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a478-9f63-4e96-80fb-1d80786c0912 None admin] RBAC: Adding query filter params (group.id=1a96bd7d940745a39ff55d7e8681bc67, role.id=e104332d9de24bed8d32257cab931633, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:19.003543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a478-9f63-4e96-80fb-1d80786c0912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:19.004981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd8a478-9f63-4e96-80fb-1d80786c0912 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:19.013833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 183/375] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:18 2022] GET /identity/v3/role_assignments?group.id=1a96bd7d940745a39ff55d7e8681bc67&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=e104332d9de24bed8d32257cab931633 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:19.015453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183a00-38d8-4073-995a-812f1f7a11ef None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.015746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183a00-38d8-4073-995a-812f1f7a11ef None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.016019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85183a00-38d8-4073-995a-812f1f7a11ef None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.017546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 184/376] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:19.019841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85183a00-38d8-4073-995a-812f1f7a11ef None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:19.122287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e638d8c-ef49-4fde-944d-ac98508438b9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:19.131759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:19.169100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85183a00-38d8-4073-995a-812f1f7a11ef None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:19.178708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7db65-7827-4599-94db-70a021a71069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:19.179668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7db65-7827-4599-94db-70a021a71069 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.180157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7db65-7827-4599-94db-70a021a71069 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.180870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7db65-7827-4599-94db-70a021a71069 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.183123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7db65-7827-4599-94db-70a021a71069 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:19.185383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7db65-7827-4599-94db-70a021a71069 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:19.188294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 193/377] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:18 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:19.190886 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291178-9d8f-4f68-80f2-1d986d313425 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.191350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291178-9d8f-4f68-80f2-1d986d313425 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.191812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28291178-9d8f-4f68-80f2-1d986d313425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.212702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-28291178-9d8f-4f68-80f2-1d986d313425 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:19.214050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-28291178-9d8f-4f68-80f2-1d986d313425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:19.251744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9479f0-2b4a-4618-8313-90a88e2ee98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:19.252312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9479f0-2b4a-4618-8313-90a88e2ee98b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.252588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9479f0-2b4a-4618-8313-90a88e2ee98b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.252875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9479f0-2b4a-4618-8313-90a88e2ee98b None admin] PATH_INFO: `/v3/projects/ee2e995cfe564d738c96205c2a9aff37` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.254028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9479f0-2b4a-4618-8313-90a88e2ee98b None admin] RBAC: Authorizing `identity:get_project(project_id=ee2e995cfe564d738c96205c2a9aff37)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:19.255514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9479f0-2b4a-4618-8313-90a88e2ee98b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:19.257271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 185/378] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:19 2022] GET /identity/v3/projects/ee2e995cfe564d738c96205c2a9aff37 => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:19.262710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9479f0-2b4a-4618-8313-90a88e2ee98b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:19.293690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 194/379] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:19.295139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28291178-9d8f-4f68-80f2-1d986d313425 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:19.306823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:19.383899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9479f0-2b4a-4618-8313-90a88e2ee98b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:19.423006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:19.423520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.424407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.424682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.425538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] RBAC: Adding query filter params (group.id=1a96bd7d940745a39ff55d7e8681bc67, role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:19.425865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:19.427423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:19.431907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28291178-9d8f-4f68-80f2-1d986d313425 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:19.434176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 186/380] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:19 2022] GET /identity/v3/role_assignments?group.id=1a96bd7d940745a39ff55d7e8681bc67&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:19.476624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84709868-40bf-4104-bd82-8b93fc44d030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:19.478019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709868-40bf-4104-bd82-8b93fc44d030 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.478517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709868-40bf-4104-bd82-8b93fc44d030 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.478981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84709868-40bf-4104-bd82-8b93fc44d030 None admin] PATH_INFO: `/v3/groups/ff14d262525240f88c01bb6715bf5a63` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.485095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84709868-40bf-4104-bd82-8b93fc44d030 None admin] RBAC: Authorizing `identity:get_group(group_id=ff14d262525240f88c01bb6715bf5a63)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:19.487653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84709868-40bf-4104-bd82-8b93fc44d030 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:19.489646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 195/381] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:19 2022] GET /identity/v3/groups/ff14d262525240f88c01bb6715bf5a63 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:19.495865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:19.513900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:19.663076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9ba29-a354-42cd-a195-649cb86ecac7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:19.678616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84709868-40bf-4104-bd82-8b93fc44d030 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:19.723295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:19.723919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.724229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.724478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.725222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] RBAC: Adding query filter params (group.id=ff14d262525240f88c01bb6715bf5a63, role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=ee2e995cfe564d738c96205c2a9aff37) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:19.725564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:19.727000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:19.734357 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 187/382] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:19 2022] GET /identity/v3/role_assignments?group.id=ff14d262525240f88c01bb6715bf5a63&scope.project.id=ee2e995cfe564d738c96205c2a9aff37&role.id=f21c9b5697b747d39bf8f104797da245 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:19.778477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:19.820519 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84709868-40bf-4104-bd82-8b93fc44d030 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:19.867849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bba5e7-ed34-40fd-9d70-4205226cb5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:19.868763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bba5e7-ed34-40fd-9d70-4205226cb5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:19.869193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bba5e7-ed34-40fd-9d70-4205226cb5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:19.869642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bba5e7-ed34-40fd-9d70-4205226cb5b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:19.888361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bba5e7-ed34-40fd-9d70-4205226cb5b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-77bba5e7-ed34-40fd-9d70-4205226cb5b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:19.894286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:19.895437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:19.896425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:19.898821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 196/383] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:19.907021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:19.998428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:20.036573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314186a1-06ea-4e29-84c2-2f4662501814 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:20.084959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6415f6-f541-4177-a10f-fd9ce292b9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:20.085581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6415f6-f541-4177-a10f-fd9ce292b9d4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:20.085870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6415f6-f541-4177-a10f-fd9ce292b9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:20.086178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6415f6-f541-4177-a10f-fd9ce292b9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:20.086855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6415f6-f541-4177-a10f-fd9ce292b9d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:20.087162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6415f6-f541-4177-a10f-fd9ce292b9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:20.088606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6415f6-f541-4177-a10f-fd9ce292b9d4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:20.101086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 188/384] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:20.106952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bba5e7-ed34-40fd-9d70-4205226cb5b7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:20.150419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b743bea-8021-4174-80a6-200431d5886c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:20.150736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b743bea-8021-4174-80a6-200431d5886c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:20.151099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b743bea-8021-4174-80a6-200431d5886c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:20.152718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 189/385] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:20.164053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9a254-22c8-4311-af4c-249a5b85d2f2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:20.164350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9a254-22c8-4311-af4c-249a5b85d2f2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:20.164637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9a254-22c8-4311-af4c-249a5b85d2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:20.195377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-44d9a254-22c8-4311-af4c-249a5b85d2f2 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:20.196605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-44d9a254-22c8-4311-af4c-249a5b85d2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:20.238012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bba5e7-ed34-40fd-9d70-4205226cb5b7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:20.271552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:20.277015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706db2a-e10e-4ebc-9353-e60bd53e4db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:20.277793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706db2a-e10e-4ebc-9353-e60bd53e4db2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:20.278165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706db2a-e10e-4ebc-9353-e60bd53e4db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:20.278484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706db2a-e10e-4ebc-9353-e60bd53e4db2 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:20.280131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706db2a-e10e-4ebc-9353-e60bd53e4db2 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:20.282191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5706db2a-e10e-4ebc-9353-e60bd53e4db2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:20.288501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 197/386] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:20 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:20.290873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706db2a-e10e-4ebc-9353-e60bd53e4db2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:20.318281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 190/387] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:20.414140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706db2a-e10e-4ebc-9353-e60bd53e4db2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:20.451223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00ed2b-8a6d-4750-bd5b-fce5dd35ba93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:20.451870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ed2b-8a6d-4750-bd5b-fce5dd35ba93 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:20.452155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ed2b-8a6d-4750-bd5b-fce5dd35ba93 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:20.452434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00ed2b-8a6d-4750-bd5b-fce5dd35ba93 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:20.453582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00ed2b-8a6d-4750-bd5b-fce5dd35ba93 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:20.455791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00ed2b-8a6d-4750-bd5b-fce5dd35ba93 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:20.457995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 198/388] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:20 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:20.463744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9a254-22c8-4311-af4c-249a5b85d2f2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:20.552607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:20.598088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9a254-22c8-4311-af4c-249a5b85d2f2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:20.642560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306443f-beca-4d7a-9196-319f75346076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:20.643770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306443f-beca-4d7a-9196-319f75346076 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:20.644064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306443f-beca-4d7a-9196-319f75346076 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:20.644336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306443f-beca-4d7a-9196-319f75346076 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a/groups/1a96bd7d940745a39ff55d7e8681bc67/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:20.650605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306443f-beca-4d7a-9196-319f75346076 None admin] RBAC: Authorizing `identity:create_grant(project_id=0984058b3d114dee94ef957c8703fd0a, group_id=1a96bd7d940745a39ff55d7e8681bc67, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:20.652061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306443f-beca-4d7a-9196-319f75346076 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:20.685865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 191/389] 10.222.0.88 () {58 vars in 1442 bytes} [Fri Aug 26 00:25:20 2022] PUT /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a/groups/1a96bd7d940745a39ff55d7e8681bc67/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:20.755525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00ed2b-8a6d-4750-bd5b-fce5dd35ba93 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:20.854957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:20.904643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00ed2b-8a6d-4750-bd5b-fce5dd35ba93 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:20.958216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0723-b4e3-49ae-bafb-29f5d215801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:20.958891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0723-b4e3-49ae-bafb-29f5d215801e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:20.959179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0723-b4e3-49ae-bafb-29f5d215801e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:20.959460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e0723-b4e3-49ae-bafb-29f5d215801e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:20.973174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e0723-b4e3-49ae-bafb-29f5d215801e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f48e0723-b4e3-49ae-bafb-29f5d215801e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:20.982767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:20.983759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:20.984646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 199/390] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:25:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:20.991151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306443f-beca-4d7a-9196-319f75346076 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:21.119721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306443f-beca-4d7a-9196-319f75346076 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:21.148139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:21.162911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:21.163894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:21.164398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:21.164880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:21.165756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:21.166330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:21.167911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:21.181329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 192/391] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:21.186891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0723-b4e3-49ae-bafb-29f5d215801e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:21.324830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e0723-b4e3-49ae-bafb-29f5d215801e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:21.355586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:21.368675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44377b0d-8598-495d-b13f-250b74562534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:21.369325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44377b0d-8598-495d-b13f-250b74562534 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:21.369612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44377b0d-8598-495d-b13f-250b74562534 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:21.369978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44377b0d-8598-495d-b13f-250b74562534 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:21.371078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44377b0d-8598-495d-b13f-250b74562534 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:21.372546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44377b0d-8598-495d-b13f-250b74562534 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:21.374479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 200/392] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:21 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:21.381098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:21.557613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc8c63-a5e1-45aa-b180-9f3be76f8c4f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:21.605701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec9cd52-9495-41c5-aa06-352f9ee5cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:21.606884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9cd52-9495-41c5-aa06-352f9ee5cc73 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:21.607380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9cd52-9495-41c5-aa06-352f9ee5cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:21.607863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec9cd52-9495-41c5-aa06-352f9ee5cc73 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:21.609518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9cd52-9495-41c5-aa06-352f9ee5cc73 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:21.611880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec9cd52-9495-41c5-aa06-352f9ee5cc73 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:21.613923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 193/393] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:21 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:21.620379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44377b0d-8598-495d-b13f-250b74562534 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:21.775124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44377b0d-8598-495d-b13f-250b74562534 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:21.832171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4acac4-c66c-4e26-9102-cd16d123d6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:21.832868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4acac4-c66c-4e26-9102-cd16d123d6ff None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:21.833158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4acac4-c66c-4e26-9102-cd16d123d6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:21.833439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4acac4-c66c-4e26-9102-cd16d123d6ff None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a/groups/1a96bd7d940745a39ff55d7e8681bc67/roles/04b06cf4afbb4f3fa6cb347496ae7a81` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:21.835709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4acac4-c66c-4e26-9102-cd16d123d6ff None admin] RBAC: Authorizing `identity:create_grant(project_id=0984058b3d114dee94ef957c8703fd0a, group_id=1a96bd7d940745a39ff55d7e8681bc67, role_id=04b06cf4afbb4f3fa6cb347496ae7a81)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:21.837196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4acac4-c66c-4e26-9102-cd16d123d6ff None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:21.854269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 201/394] 10.222.0.88 () {58 vars in 1442 bytes} [Fri Aug 26 00:25:21 2022] PUT /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a/groups/1a96bd7d940745a39ff55d7e8681bc67/roles/04b06cf4afbb4f3fa6cb347496ae7a81 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:21.920776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cdd47-6ef6-409a-8b5f-7881c8d717a6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:21.921416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cdd47-6ef6-409a-8b5f-7881c8d717a6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:21.921931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078cdd47-6ef6-409a-8b5f-7881c8d717a6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:21.924051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 194/395] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:21.930159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec017bd-77b9-4989-bdbe-c36d34423f9b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:21.930726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec017bd-77b9-4989-bdbe-c36d34423f9b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:21.930979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec017bd-77b9-4989-bdbe-c36d34423f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:21.946121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca410-50ae-4a1b-8600-14061bf513d0 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:21.946754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca410-50ae-4a1b-8600-14061bf513d0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:21.947260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ca410-50ae-4a1b-8600-14061bf513d0 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:21.949138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 195/396] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:21.951429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7ec017bd-77b9-4989-bdbe-c36d34423f9b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:21.952679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7ec017bd-77b9-4989-bdbe-c36d34423f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:21.955331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079a69-4bb2-4fb8-a747-ecc3c2872720 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:21.956067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079a69-4bb2-4fb8-a747-ecc3c2872720 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:21.956563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76079a69-4bb2-4fb8-a747-ecc3c2872720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:21.996708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-76079a69-4bb2-4fb8-a747-ecc3c2872720 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:21.997955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-76079a69-4bb2-4fb8-a747-ecc3c2872720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:22.058337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:22.089635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 202/397] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:22.099270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:22.122203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 196/398] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:22.416298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec017bd-77b9-4989-bdbe-c36d34423f9b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:22.536474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec017bd-77b9-4989-bdbe-c36d34423f9b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:22.567352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6780c0-c81d-4f9f-9bbf-b05575dd332c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:22.567897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6780c0-c81d-4f9f-9bbf-b05575dd332c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:22.567897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6780c0-c81d-4f9f-9bbf-b05575dd332c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:22.569463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 197/399] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:25:22.583229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc5f1c-7175-48a0-b3b7-470e8ade103d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:22.583512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc5f1c-7175-48a0-b3b7-470e8ade103d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:22.583788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bc5f1c-7175-48a0-b3b7-470e8ade103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:22.584152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3900-a937-491d-88f9-52eae48ef667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:22.584802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3900-a937-491d-88f9-52eae48ef667 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:22.585090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3900-a937-491d-88f9-52eae48ef667 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:22.585371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c3900-a937-491d-88f9-52eae48ef667 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:22.596775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c3900-a937-491d-88f9-52eae48ef667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-328c3900-a937-491d-88f9-52eae48ef667 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:22.601839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:22.602720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:22.603498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 203/400] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:22.610461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3900-a937-491d-88f9-52eae48ef667 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:22.623474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-40bc5f1c-7175-48a0-b3b7-470e8ade103d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:22.624679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-40bc5f1c-7175-48a0-b3b7-470e8ade103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:22.670378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:22.698168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 198/401] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:22.699482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc5f1c-7175-48a0-b3b7-470e8ade103d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:22.739785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c3900-a937-491d-88f9-52eae48ef667 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:22.806177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:22.806835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:22.807061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:22.807328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:22.808002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:22.808308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:22.809693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:22.832497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 204/402] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:22.838669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:22.861244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bc5f1c-7175-48a0-b3b7-470e8ade103d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:22.875751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:22.898963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd5257-c0e9-4688-a91f-e7ddceaeb96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:22.899970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd5257-c0e9-4688-a91f-e7ddceaeb96c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:22.900454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd5257-c0e9-4688-a91f-e7ddceaeb96c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:22.900927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fd5257-c0e9-4688-a91f-e7ddceaeb96c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:22.911963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fd5257-c0e9-4688-a91f-e7ddceaeb96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-59fd5257-c0e9-4688-a91f-e7ddceaeb96c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:22.917014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:22.918340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:22.919105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:22.921223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 199/403] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:25:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:22.928794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd5257-c0e9-4688-a91f-e7ddceaeb96c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.047747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b350317b-44d1-400c-9c13-a295d0e431a8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.055447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fd5257-c0e9-4688-a91f-e7ddceaeb96c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.067274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:23.091432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.092426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.092954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.093431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.094323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:23.094831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:23.096935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:23.102918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa00c-207c-408b-abe6-6ef63e507383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.103548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa00c-207c-408b-abe6-6ef63e507383 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.103831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa00c-207c-408b-abe6-6ef63e507383 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.104109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa00c-207c-408b-abe6-6ef63e507383 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.105234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa00c-207c-408b-abe6-6ef63e507383 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:23.106893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa00c-207c-408b-abe6-6ef63e507383 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:23.107320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 200/404] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:23.108347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.113676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 205/405] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:22 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:23.114648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa00c-207c-408b-abe6-6ef63e507383 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.146124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:23.246052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5799a43-808e-4366-bb02-9ae67b5586bf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.287998 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa4107-7cc4-4b0a-9ffa-21f7b634f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.289471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa4107-7cc4-4b0a-9ffa-21f7b634f36e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.289471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa4107-7cc4-4b0a-9ffa-21f7b634f36e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.289471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fa4107-7cc4-4b0a-9ffa-21f7b634f36e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.303303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fa4107-7cc4-4b0a-9ffa-21f7b634f36e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-36fa4107-7cc4-4b0a-9ffa-21f7b634f36e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:23.310226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:23.311366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:23.312325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:23.320867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 201/406] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:25:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:23.320867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa4107-7cc4-4b0a-9ffa-21f7b634f36e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.324097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa00c-207c-408b-abe6-6ef63e507383 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.383018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81aefc-451a-463e-ba42-78127eea7152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.384005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81aefc-451a-463e-ba42-78127eea7152 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.384582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81aefc-451a-463e-ba42-78127eea7152 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.385053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81aefc-451a-463e-ba42-78127eea7152 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.386673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81aefc-451a-463e-ba42-78127eea7152 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:23.388401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f81aefc-451a-463e-ba42-78127eea7152 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:23.390757 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 206/407] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:23 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:23.391750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81aefc-451a-463e-ba42-78127eea7152 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.446072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:23.456247 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:23.462259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fa4107-7cc4-4b0a-9ffa-21f7b634f36e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.506619 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303e06e-153b-4ca5-8024-b178661a9c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.507567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303e06e-153b-4ca5-8024-b178661a9c93 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.508074 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303e06e-153b-4ca5-8024-b178661a9c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.508548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303e06e-153b-4ca5-8024-b178661a9c93 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.510192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303e06e-153b-4ca5-8024-b178661a9c93 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:23.511990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303e06e-153b-4ca5-8024-b178661a9c93 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:23.518797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81aefc-451a-463e-ba42-78127eea7152 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.519456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 202/408] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:23 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:23.521024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1de8-35aa-4623-b717-c9689b8695c8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.521617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1de8-35aa-4623-b717-c9689b8695c8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.522427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa1de8-35aa-4623-b717-c9689b8695c8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.524635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 203/409] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:23.525607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa1de8-35aa-4623-b717-c9689b8695c8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.560958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.561573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.561855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.562430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.562823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:23.563130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:23.565108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:23.589651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 207/410] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:23.590626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.653527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa1de8-35aa-4623-b717-c9689b8695c8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.692288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635d132-93e7-4dda-ba23-98f876ca31fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.693400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d132-93e7-4dda-ba23-98f876ca31fb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.694011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d132-93e7-4dda-ba23-98f876ca31fb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.694449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635d132-93e7-4dda-ba23-98f876ca31fb None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.696217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635d132-93e7-4dda-ba23-98f876ca31fb None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:23.698611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635d132-93e7-4dda-ba23-98f876ca31fb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:23.700268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929b7ca-93c0-4374-964b-fdba471e7282 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.700946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 204/411] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:23 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:23.703227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f3df-4685-4862-9ebe-c924a3cddf1d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.703657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f3df-4685-4862-9ebe-c924a3cddf1d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.704057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3f3df-4685-4862-9ebe-c924a3cddf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.708287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:23.726308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-84a3f3df-4685-4862-9ebe-c924a3cddf1d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:23.727994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-84a3f3df-4685-4862-9ebe-c924a3cddf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:23.738547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508aff7-dfcf-401d-9708-4c54a18e1c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.739276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508aff7-dfcf-401d-9708-4c54a18e1c52 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.739562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508aff7-dfcf-401d-9708-4c54a18e1c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.739953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508aff7-dfcf-401d-9708-4c54a18e1c52 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/groups/1a96bd7d940745a39ff55d7e8681bc67/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.741836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508aff7-dfcf-401d-9708-4c54a18e1c52 None admin] RBAC: Authorizing `identity:create_grant(project_id=19bae8bf30dd4530b67b9f4d3bf46159, group_id=1a96bd7d940745a39ff55d7e8681bc67, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:23.743331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508aff7-dfcf-401d-9708-4c54a18e1c52 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:23.757077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:23.757608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 208/412] 10.222.0.88 () {58 vars in 1442 bytes} [Fri Aug 26 00:25:23 2022] PUT /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/groups/1a96bd7d940745a39ff55d7e8681bc67/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:23.758894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508aff7-dfcf-401d-9708-4c54a18e1c52 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.832029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 205/413] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:23.834036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3f3df-4685-4862-9ebe-c924a3cddf1d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.884576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508aff7-dfcf-401d-9708-4c54a18e1c52 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.924171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a060610-160b-4401-9d26-fdc33f5c99e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:23.925587 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a060610-160b-4401-9d26-fdc33f5c99e3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:23.925961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a060610-160b-4401-9d26-fdc33f5c99e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:23.926291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a060610-160b-4401-9d26-fdc33f5c99e3 None admin] PATH_INFO: `/v3/groups/ff14d262525240f88c01bb6715bf5a63` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:23.927545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a060610-160b-4401-9d26-fdc33f5c99e3 None admin] RBAC: Authorizing `identity:get_group(group_id=ff14d262525240f88c01bb6715bf5a63)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:23.929020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a060610-160b-4401-9d26-fdc33f5c99e3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:23.931277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 209/414] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:23 2022] GET /identity/v3/groups/ff14d262525240f88c01bb6715bf5a63 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:23.938014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a060610-160b-4401-9d26-fdc33f5c99e3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:23.967819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3f3df-4685-4862-9ebe-c924a3cddf1d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:23.980027 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:24.020792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7fe1b-e638-48a0-886a-ed9ef36a1d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:24.021403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7fe1b-e638-48a0-886a-ed9ef36a1d36 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:24.021684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7fe1b-e638-48a0-886a-ed9ef36a1d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:24.022003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc7fe1b-e638-48a0-886a-ed9ef36a1d36 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/groups/1a96bd7d940745a39ff55d7e8681bc67/roles/04b06cf4afbb4f3fa6cb347496ae7a81` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:24.026647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7fe1b-e638-48a0-886a-ed9ef36a1d36 None admin] RBAC: Authorizing `identity:create_grant(project_id=19bae8bf30dd4530b67b9f4d3bf46159, group_id=1a96bd7d940745a39ff55d7e8681bc67, role_id=04b06cf4afbb4f3fa6cb347496ae7a81)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:24.028272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc7fe1b-e638-48a0-886a-ed9ef36a1d36 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:24.046448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 206/415] 10.222.0.88 () {58 vars in 1442 bytes} [Fri Aug 26 00:25:23 2022] PUT /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159/groups/1a96bd7d940745a39ff55d7e8681bc67/roles/04b06cf4afbb4f3fa6cb347496ae7a81 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:24.093828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a060610-160b-4401-9d26-fdc33f5c99e3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:24.140733 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793571f0-0494-4d35-b94c-10f46835a7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:24.141386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793571f0-0494-4d35-b94c-10f46835a7b0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:24.141721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793571f0-0494-4d35-b94c-10f46835a7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:24.142608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793571f0-0494-4d35-b94c-10f46835a7b0 None admin] PATH_INFO: `/v3/projects/ee2e995cfe564d738c96205c2a9aff37` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:24.143770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793571f0-0494-4d35-b94c-10f46835a7b0 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2e995cfe564d738c96205c2a9aff37)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:24.145341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793571f0-0494-4d35-b94c-10f46835a7b0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:24.147583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 210/416] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:23 2022] GET /identity/v3/projects/ee2e995cfe564d738c96205c2a9aff37 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:24.153489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7fe1b-e638-48a0-886a-ed9ef36a1d36 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:24.184789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:24.187741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793571f0-0494-4d35-b94c-10f46835a7b0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:24.292173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc7fe1b-e638-48a0-886a-ed9ef36a1d36 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:24.320527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:24.325323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793571f0-0494-4d35-b94c-10f46835a7b0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:24.331735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea7824f-838b-4e73-808d-16126ac142c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:24.332492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7824f-838b-4e73-808d-16126ac142c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:24.332878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7824f-838b-4e73-808d-16126ac142c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:24.333226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea7824f-838b-4e73-808d-16126ac142c8 None admin] PATH_INFO: `/v3/projects/ee2e995cfe564d738c96205c2a9aff37/groups/ff14d262525240f88c01bb6715bf5a63/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:24.335310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7824f-838b-4e73-808d-16126ac142c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ee2e995cfe564d738c96205c2a9aff37, group_id=ff14d262525240f88c01bb6715bf5a63, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:24.336941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea7824f-838b-4e73-808d-16126ac142c8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:24.353062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 207/417] 10.222.0.88 () {58 vars in 1442 bytes} [Fri Aug 26 00:25:24 2022] PUT /identity/v3/projects/ee2e995cfe564d738c96205c2a9aff37/groups/ff14d262525240f88c01bb6715bf5a63/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:25:24.359126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4562-a45c-4c3a-9f38-27256adf3d4d None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:24.359787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4562-a45c-4c3a-9f38-27256adf3d4d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:24.360071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c4562-a45c-4c3a-9f38-27256adf3d4d None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:24.362406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 208/418] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:24.374033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0916b-8e52-4ede-b68c-2ff549abdb79 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:24.374033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0916b-8e52-4ede-b68c-2ff549abdb79 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:24.374033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a0916b-8e52-4ede-b68c-2ff549abdb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:24.393410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-13a0916b-8e52-4ede-b68c-2ff549abdb79 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:24.394454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a205298-e469-45b0-95c4-1bc796a09f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:24.395264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-13a0916b-8e52-4ede-b68c-2ff549abdb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:24.395494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205298-e469-45b0-95c4-1bc796a09f49 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:24.395876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205298-e469-45b0-95c4-1bc796a09f49 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:24.396251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a205298-e469-45b0-95c4-1bc796a09f49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:24.422955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a205298-e469-45b0-95c4-1bc796a09f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-2a205298-e469-45b0-95c4-1bc796a09f49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:24.429046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:24.430535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:24.431338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:24.438609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 211/419] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:24.445686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a205298-e469-45b0-95c4-1bc796a09f49 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:24.500380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 209/420] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:24.608754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a205298-e469-45b0-95c4-1bc796a09f49 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:24.648966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:24.649576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:24.649860 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:24.650171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:24.650848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:24.651157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:24.653003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:24.666576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 212/421] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:24.671994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0916b-8e52-4ede-b68c-2ff549abdb79 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:24.686645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:24.785674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a0916b-8e52-4ede-b68c-2ff549abdb79 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:24.823087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b796-b102-498e-9f78-098b2e8990b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:24.823756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b796-b102-498e-9f78-098b2e8990b5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:24.823983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b796-b102-498e-9f78-098b2e8990b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:24.824260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a4b796-b102-498e-9f78-098b2e8990b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:24.896985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4b796-b102-498e-9f78-098b2e8990b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:24.898532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a4b796-b102-498e-9f78-098b2e8990b5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:24.910930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:24.955636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:25.009252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 210/422] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:25.018382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b796-b102-498e-9f78-098b2e8990b5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:25.029343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:25.163234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93796cad-4776-47d0-8868-59be6a185821 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:25.192577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a4b796-b102-498e-9f78-098b2e8990b5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:25.218259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:25.235185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b36d-77ed-4efe-87f5-67cda37cf0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:25.236421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b36d-77ed-4efe-87f5-67cda37cf0a4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:25.236675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b36d-77ed-4efe-87f5-67cda37cf0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:25.236913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5b36d-77ed-4efe-87f5-67cda37cf0a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:25.255797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a5b36d-77ed-4efe-87f5-67cda37cf0a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-22a5b36d-77ed-4efe-87f5-67cda37cf0a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:25.260994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:25.261851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:25.262687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 213/423] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:25:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:25.269058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c9c02-4fd5-43c2-95c0-b858c9eb0cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:25.269771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9c02-4fd5-43c2-95c0-b858c9eb0cdd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:25.270077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9c02-4fd5-43c2-95c0-b858c9eb0cdd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:25.270357 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63c9c02-4fd5-43c2-95c0-b858c9eb0cdd None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:25.271596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c9c02-4fd5-43c2-95c0-b858c9eb0cdd None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:25.273046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63c9c02-4fd5-43c2-95c0-b858c9eb0cdd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:25.274683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 211/424] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:25 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:25.275632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b36d-77ed-4efe-87f5-67cda37cf0a4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:25.290330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c9c02-4fd5-43c2-95c0-b858c9eb0cdd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:25.427835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:25.462046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5b36d-77ed-4efe-87f5-67cda37cf0a4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:25.465586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63c9c02-4fd5-43c2-95c0-b858c9eb0cdd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:25.529597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:25.530243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:25.530524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:25.530799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:25.531469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:25.531773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:25.533886 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:25.535792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958168b-651b-497c-a81b-eb90bcfd9f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:25.536431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958168b-651b-497c-a81b-eb90bcfd9f93 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:25.536705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958168b-651b-497c-a81b-eb90bcfd9f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:25.536972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958168b-651b-497c-a81b-eb90bcfd9f93 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:25.538183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958168b-651b-497c-a81b-eb90bcfd9f93 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:25.539721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958168b-651b-497c-a81b-eb90bcfd9f93 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:25.546943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 212/425] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:25 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:25.553444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958168b-651b-497c-a81b-eb90bcfd9f93 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:25.565967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 214/426] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:25.566996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:25.642376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:25.739845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958168b-651b-497c-a81b-eb90bcfd9f93 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:25.763928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fadf69a-f0c5-4fe0-9f42-b7f2d4d71013 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:25.804137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a51181-2795-4c61-bc84-bf3e1477039e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:25.805422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51181-2795-4c61-bc84-bf3e1477039e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:25.805702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51181-2795-4c61-bc84-bf3e1477039e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:25.806236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a51181-2795-4c61-bc84-bf3e1477039e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:25.807795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a51181-2795-4c61-bc84-bf3e1477039e None admin] RBAC: Adding query filter params (group.id=1a96bd7d940745a39ff55d7e8681bc67, role.id=e104332d9de24bed8d32257cab931633, scope.project.id=0984058b3d114dee94ef957c8703fd0a) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:25.808114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a51181-2795-4c61-bc84-bf3e1477039e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:25.809547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a51181-2795-4c61-bc84-bf3e1477039e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:25.824048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b865633-279d-476d-9a36-254bf94da599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:25.824791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 213/427] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:25 2022] GET /identity/v3/role_assignments?group.id=1a96bd7d940745a39ff55d7e8681bc67&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=e104332d9de24bed8d32257cab931633 => generated 611 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:25.828575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865633-279d-476d-9a36-254bf94da599 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:25.828925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865633-279d-476d-9a36-254bf94da599 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:25.829205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b865633-279d-476d-9a36-254bf94da599 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:25.857067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:25.948268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b865633-279d-476d-9a36-254bf94da599 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:25.949760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b865633-279d-476d-9a36-254bf94da599 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:26.079020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340712-e83d-4ee6-9f52-a8fc8aa7d9fe None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.079366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340712-e83d-4ee6-9f52-a8fc8aa7d9fe None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.079634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c340712-e83d-4ee6-9f52-a8fc8aa7d9fe None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.081326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 214/428] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:25:26.086596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e1ca5-a6cf-43b2-920f-7f788db44165 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.086875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e1ca5-a6cf-43b2-920f-7f788db44165 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.087147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e1ca5-a6cf-43b2-920f-7f788db44165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.110158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 215/429] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:26.121289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a44e1ca5-a6cf-43b2-920f-7f788db44165 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:26.121920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b865633-279d-476d-9a36-254bf94da599 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:26.122530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a44e1ca5-a6cf-43b2-920f-7f788db44165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:26.175857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:26.222159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 215/430] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:26.239131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b865633-279d-476d-9a36-254bf94da599 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:26.274594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ef76-4f13-441a-b17c-f35285ecefe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:26.275230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ef76-4f13-441a-b17c-f35285ecefe9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.275507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ef76-4f13-441a-b17c-f35285ecefe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.275779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3ef76-4f13-441a-b17c-f35285ecefe9 None admin] PATH_INFO: `/v3/projects/0984058b3d114dee94ef957c8703fd0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.276955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3ef76-4f13-441a-b17c-f35285ecefe9 None admin] RBAC: Authorizing `identity:get_project(project_id=0984058b3d114dee94ef957c8703fd0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:26.278457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3ef76-4f13-441a-b17c-f35285ecefe9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:26.280463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 216/431] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:26 2022] GET /identity/v3/projects/0984058b3d114dee94ef957c8703fd0a => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:26.286674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e1ca5-a6cf-43b2-920f-7f788db44165 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:26.351011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:26.426518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e1ca5-a6cf-43b2-920f-7f788db44165 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:26.471157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ff709-ae43-4315-bd8e-247e3062e290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:26.472215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ff709-ae43-4315-bd8e-247e3062e290 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.472721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ff709-ae43-4315-bd8e-247e3062e290 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.473221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ff709-ae43-4315-bd8e-247e3062e290 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.476757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ff709-ae43-4315-bd8e-247e3062e290 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:26.478233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ff709-ae43-4315-bd8e-247e3062e290 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:26.480207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 216/432] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:26 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:26.486547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ef76-4f13-441a-b17c-f35285ecefe9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:26.535695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ff709-ae43-4315-bd8e-247e3062e290 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:26.629397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3ef76-4f13-441a-b17c-f35285ecefe9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:26.646197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:26.664807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ff709-ae43-4315-bd8e-247e3062e290 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:26.674539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:26.676696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618dfc4-e36a-48a2-8fbc-9f68e3227815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:26.677323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618dfc4-e36a-48a2-8fbc-9f68e3227815 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.677606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618dfc4-e36a-48a2-8fbc-9f68e3227815 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.677901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618dfc4-e36a-48a2-8fbc-9f68e3227815 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.678642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618dfc4-e36a-48a2-8fbc-9f68e3227815 None admin] RBAC: Adding query filter params (group.id=1a96bd7d940745a39ff55d7e8681bc67, role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=0984058b3d114dee94ef957c8703fd0a) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:26.678963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618dfc4-e36a-48a2-8fbc-9f68e3227815 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:26.680657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618dfc4-e36a-48a2-8fbc-9f68e3227815 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:26.686544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 217/433] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:26 2022] GET /identity/v3/role_assignments?group.id=1a96bd7d940745a39ff55d7e8681bc67&scope.project.id=0984058b3d114dee94ef957c8703fd0a&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:26.687689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581369b-844f-46a6-8e53-612e324f889b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.687978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581369b-844f-46a6-8e53-612e324f889b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.688331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581369b-844f-46a6-8e53-612e324f889b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.690747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 218/434] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:26.695702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f2b58-243d-469c-b296-0c8eee0d21a4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.696008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f2b58-243d-469c-b296-0c8eee0d21a4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.696586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f2b58-243d-469c-b296-0c8eee0d21a4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.697938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 219/435] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:26.699013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ddaf0-9173-4dc9-911d-ee725cf7a4ab None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.699298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ddaf0-9173-4dc9-911d-ee725cf7a4ab None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.699566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951ddaf0-9173-4dc9-911d-ee725cf7a4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.701944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b7d7d0-48a8-4f13-98af-da23473e346c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:26.702821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d7d0-48a8-4f13-98af-da23473e346c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.703260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d7d0-48a8-4f13-98af-da23473e346c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.703674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b7d7d0-48a8-4f13-98af-da23473e346c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.718075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b7d7d0-48a8-4f13-98af-da23473e346c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:26.719269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-951ddaf0-9173-4dc9-911d-ee725cf7a4ab None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:26.721470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-951ddaf0-9173-4dc9-911d-ee725cf7a4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-62b7d7d0-48a8-4f13-98af-da23473e346c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:26.724159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:26.725035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:26.725800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 217/436] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:26.727884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891254-f758-4397-8c27-a2b6f0337582 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.727884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891254-f758-4397-8c27-a2b6f0337582 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.727884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c891254-f758-4397-8c27-a2b6f0337582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.747705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9c891254-f758-4397-8c27-a2b6f0337582 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:26.748935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9c891254-f758-4397-8c27-a2b6f0337582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:26.808439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 220/437] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:26.809532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ddaf0-9173-4dc9-911d-ee725cf7a4ab None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:26.845899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 218/438] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:26.931446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951ddaf0-9173-4dc9-911d-ee725cf7a4ab None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:26.939347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:26.967804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:26.968431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:26.968714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:26.969002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:26.969728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] RBAC: Adding query filter params (name=member) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:26.970654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:26.972248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:26.981375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 221/439] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:25:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:26.987634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891254-f758-4397-8c27-a2b6f0337582 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.090901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.094161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:27.099669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c891254-f758-4397-8c27-a2b6f0337582 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.144884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f40984-290c-4d4d-b3a7-9a07a7f81709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.145499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f40984-290c-4d4d-b3a7-9a07a7f81709 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.145791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f40984-290c-4d4d-b3a7-9a07a7f81709 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.146121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f40984-290c-4d4d-b3a7-9a07a7f81709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.211953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228740-00bd-41ec-8241-b8fcc3742c32 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.217857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f40984-290c-4d4d-b3a7-9a07a7f81709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:27.219378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f40984-290c-4d4d-b3a7-9a07a7f81709 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:27.247763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbf652-75fe-40f0-9de0-c4bc34672a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.248400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf652-75fe-40f0-9de0-c4bc34672a7d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.248688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf652-75fe-40f0-9de0-c4bc34672a7d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.248966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cbf652-75fe-40f0-9de0-c4bc34672a7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.259178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cbf652-75fe-40f0-9de0-c4bc34672a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-21cbf652-75fe-40f0-9de0-c4bc34672a7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:27.264457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:27.265514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 222/440] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:27.266567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbf652-75fe-40f0-9de0-c4bc34672a7d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.295205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:27.318690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:27.323727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 219/441] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:27.324543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f40984-290c-4d4d-b3a7-9a07a7f81709 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.368450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cbf652-75fe-40f0-9de0-c4bc34672a7d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.401993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea01157-390d-4dd0-ba64-927e3e56e93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.402618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea01157-390d-4dd0-ba64-927e3e56e93a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.402894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea01157-390d-4dd0-ba64-927e3e56e93a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.403181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea01157-390d-4dd0-ba64-927e3e56e93a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.413271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea01157-390d-4dd0-ba64-927e3e56e93a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fea01157-390d-4dd0-ba64-927e3e56e93a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:27.418503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:27.419532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 223/442] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:27.420510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea01157-390d-4dd0-ba64-927e3e56e93a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.429278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f40984-290c-4d4d-b3a7-9a07a7f81709 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.463870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.464399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.464682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.464954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.465616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:27.465938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:27.467299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:27.475962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 220/443] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:27.476732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.510789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:27.523074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea01157-390d-4dd0-ba64-927e3e56e93a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.535980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:27.558299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531208-3ed2-4549-888d-77e6b2beabc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.558918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531208-3ed2-4549-888d-77e6b2beabc3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.559200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531208-3ed2-4549-888d-77e6b2beabc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.559468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26531208-3ed2-4549-888d-77e6b2beabc3 None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.560586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531208-3ed2-4549-888d-77e6b2beabc3 None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:27.562065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26531208-3ed2-4549-888d-77e6b2beabc3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:27.564265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 224/444] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:27.569152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531208-3ed2-4549-888d-77e6b2beabc3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.581916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec2c59f-92bd-440c-b5d8-85b06de2821b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.616391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.616997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.617279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.617561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.618286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:27.618607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:27.619952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:27.627695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 221/445] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:27.628480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.680294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26531208-3ed2-4549-888d-77e6b2beabc3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.716292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b78a-b5ff-4bb0-a768-ac5bc9d06d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.716819 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b78a-b5ff-4bb0-a768-ac5bc9d06d88 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.717100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b78a-b5ff-4bb0-a768-ac5bc9d06d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.717378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed1b78a-b5ff-4bb0-a768-ac5bc9d06d88 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.742734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75e2c9-967d-4f87-94ad-7f7cba33eb1e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.746177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:27.771397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:27.787755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107ace9-7b22-442f-b0bf-f8b3b1809298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.788399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107ace9-7b22-442f-b0bf-f8b3b1809298 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.788690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107ace9-7b22-442f-b0bf-f8b3b1809298 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.788977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107ace9-7b22-442f-b0bf-f8b3b1809298 None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.790160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107ace9-7b22-442f-b0bf-f8b3b1809298 None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:27.791271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1b78a-b5ff-4bb0-a768-ac5bc9d06d88 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:27.791620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6107ace9-7b22-442f-b0bf-f8b3b1809298 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:27.793147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed1b78a-b5ff-4bb0-a768-ac5bc9d06d88 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:27.793747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 222/446] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:27.794572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107ace9-7b22-442f-b0bf-f8b3b1809298 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.916279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 225/447] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:27.917133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b78a-b5ff-4bb0-a768-ac5bc9d06d88 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:27.923755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107ace9-7b22-442f-b0bf-f8b3b1809298 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:27.966608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0a039-b132-4724-b263-9a31a82571f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:27.967178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0a039-b132-4724-b263-9a31a82571f0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:27.967461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0a039-b132-4724-b263-9a31a82571f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:27.967731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c0a039-b132-4724-b263-9a31a82571f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:27.982095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:28.025529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed1b78a-b5ff-4bb0-a768-ac5bc9d06d88 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:28.026628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:28.039225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0a039-b132-4724-b263-9a31a82571f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:28.040696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c0a039-b132-4724-b263-9a31a82571f0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:28.060228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:28.060829 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:28.061112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:28.061387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:28.062141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] RBAC: Adding query filter params (group.id=1a96bd7d940745a39ff55d7e8681bc67, role.id=e104332d9de24bed8d32257cab931633, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:28.062452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:28.063912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:28.070157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 226/448] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/role_assignments?group.id=1a96bd7d940745a39ff55d7e8681bc67&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=e104332d9de24bed8d32257cab931633 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:28.070933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:28.148292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 223/449] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:28.153861 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0a039-b132-4724-b263-9a31a82571f0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:28.190601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e55b8-af4c-4a06-a9c0-c7d65a0f6d7c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:28.212736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:28.235326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7b1f4-3ee9-4a7f-a4cc-0db99ee96402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:28.236120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b1f4-3ee9-4a7f-a4cc-0db99ee96402 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:28.236402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b1f4-3ee9-4a7f-a4cc-0db99ee96402 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:28.237443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc7b1f4-3ee9-4a7f-a4cc-0db99ee96402 None admin] PATH_INFO: `/v3/projects/ee2e995cfe564d738c96205c2a9aff37` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:28.239212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7b1f4-3ee9-4a7f-a4cc-0db99ee96402 None admin] RBAC: Authorizing `identity:get_project(project_id=ee2e995cfe564d738c96205c2a9aff37)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:28.240412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc7b1f4-3ee9-4a7f-a4cc-0db99ee96402 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:28.242549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 227/450] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:28 2022] GET /identity/v3/projects/ee2e995cfe564d738c96205c2a9aff37 => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:28.248004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7b1f4-3ee9-4a7f-a4cc-0db99ee96402 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:28.255065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:28.268415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c0a039-b132-4724-b263-9a31a82571f0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:28.308491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97413a-b4f6-4f69-96dc-ddae0a7acc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:28.309136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97413a-b4f6-4f69-96dc-ddae0a7acc5d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:28.309709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97413a-b4f6-4f69-96dc-ddae0a7acc5d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:28.310029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c97413a-b4f6-4f69-96dc-ddae0a7acc5d None admin] PATH_INFO: `/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:28.311350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97413a-b4f6-4f69-96dc-ddae0a7acc5d None admin] RBAC: Authorizing `identity:get_project(project_id=19bae8bf30dd4530b67b9f4d3bf46159)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:28.313403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c97413a-b4f6-4f69-96dc-ddae0a7acc5d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:28.316773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 224/451] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:25:28 2022] GET /identity/v3/projects/19bae8bf30dd4530b67b9f4d3bf46159 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:28.321972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97413a-b4f6-4f69-96dc-ddae0a7acc5d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:28.363873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc7b1f4-3ee9-4a7f-a4cc-0db99ee96402 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:28.401030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24a47-ca7b-45b5-9475-6dd51a9802e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:28.401668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24a47-ca7b-45b5-9475-6dd51a9802e0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:28.402316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24a47-ca7b-45b5-9475-6dd51a9802e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:28.402423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c24a47-ca7b-45b5-9475-6dd51a9802e0 None admin] PATH_INFO: `/v3/groups/ff14d262525240f88c01bb6715bf5a63` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:28.403625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c24a47-ca7b-45b5-9475-6dd51a9802e0 None admin] RBAC: Authorizing `identity:get_group(group_id=ff14d262525240f88c01bb6715bf5a63)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:28.405112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c24a47-ca7b-45b5-9475-6dd51a9802e0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:28.406779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 228/452] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:28 2022] GET /identity/v3/groups/ff14d262525240f88c01bb6715bf5a63 => generated 229 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:28.412821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24a47-ca7b-45b5-9475-6dd51a9802e0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:28.440313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c97413a-b4f6-4f69-96dc-ddae0a7acc5d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:28.472227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:28.475201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f3ee3-e76a-4231-bc61-b8e0a849550b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:28.476188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f3ee3-e76a-4231-bc61-b8e0a849550b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:28.476631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f3ee3-e76a-4231-bc61-b8e0a849550b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:28.476919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f3ee3-e76a-4231-bc61-b8e0a849550b None admin] PATH_INFO: `/v3/groups/1a96bd7d940745a39ff55d7e8681bc67` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:28.478085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f3ee3-e76a-4231-bc61-b8e0a849550b None admin] RBAC: Authorizing `identity:get_group(group_id=1a96bd7d940745a39ff55d7e8681bc67)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:28.479542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f3ee3-e76a-4231-bc61-b8e0a849550b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:28.481227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 225/453] 10.222.0.88 () {56 vars in 1180 bytes} [Fri Aug 26 00:25:28 2022] GET /identity/v3/groups/1a96bd7d940745a39ff55d7e8681bc67 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:28.487946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f3ee3-e76a-4231-bc61-b8e0a849550b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:28.517379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c24a47-ca7b-45b5-9475-6dd51a9802e0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:28.518510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:28.555438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451c18b-f8b8-46b8-94d1-25407bbf70f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:28.555438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c18b-f8b8-46b8-94d1-25407bbf70f0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:28.555438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c18b-f8b8-46b8-94d1-25407bbf70f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:28.555438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451c18b-f8b8-46b8-94d1-25407bbf70f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:28.555882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451c18b-f8b8-46b8-94d1-25407bbf70f0 None admin] RBAC: Adding query filter params (group.id=ff14d262525240f88c01bb6715bf5a63, role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=ee2e995cfe564d738c96205c2a9aff37) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:28.555882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451c18b-f8b8-46b8-94d1-25407bbf70f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:28.556945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451c18b-f8b8-46b8-94d1-25407bbf70f0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:28.563032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 229/454] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:28 2022] GET /identity/v3/role_assignments?group.id=ff14d262525240f88c01bb6715bf5a63&scope.project.id=ee2e995cfe564d738c96205c2a9aff37&role.id=f21c9b5697b747d39bf8f104797da245 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:28.597405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f3ee3-e76a-4231-bc61-b8e0a849550b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:28.635797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d21e5-ba50-489b-831b-8abdf54cf582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:28.636410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d21e5-ba50-489b-831b-8abdf54cf582 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:28.636692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d21e5-ba50-489b-831b-8abdf54cf582 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:28.636967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d21e5-ba50-489b-831b-8abdf54cf582 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:28.637708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d21e5-ba50-489b-831b-8abdf54cf582 None admin] RBAC: Adding query filter params (group.id=1a96bd7d940745a39ff55d7e8681bc67, role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:28.638055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d21e5-ba50-489b-831b-8abdf54cf582 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:28.639518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2d21e5-ba50-489b-831b-8abdf54cf582 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:28.646189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 226/455] 10.222.0.88 () {56 vars in 1376 bytes} [Fri Aug 26 00:25:28 2022] GET /identity/v3/role_assignments?group.id=1a96bd7d940745a39ff55d7e8681bc67&scope.project.id=19bae8bf30dd4530b67b9f4d3bf46159&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:31.359526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c87c5-89ab-4d49-8567-ffe4da78d308 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:31.361218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c87c5-89ab-4d49-8567-ffe4da78d308 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:31.361964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c87c5-89ab-4d49-8567-ffe4da78d308 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:31.363956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 230/456] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:31.369716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a596-ff0a-4669-a9fd-5fe5a76507f3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:31.370628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a596-ff0a-4669-a9fd-5fe5a76507f3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:31.371121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e79a596-ff0a-4669-a9fd-5fe5a76507f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:31.394842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5e79a596-ff0a-4669-a9fd-5fe5a76507f3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:31.396352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5e79a596-ff0a-4669-a9fd-5fe5a76507f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:31.442493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1a92-4c7f-49e3-882d-5350d0624990 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:31.443111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1a92-4c7f-49e3-882d-5350d0624990 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:31.443616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da1a92-4c7f-49e3-882d-5350d0624990 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:31.446405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 231/457] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:25:31.450916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c12e3-efd5-4e20-a5b4-fcbfac6fc8ab None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:31.451483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c12e3-efd5-4e20-a5b4-fcbfac6fc8ab None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:31.451974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73c12e3-efd5-4e20-a5b4-fcbfac6fc8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:31.479068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f73c12e3-efd5-4e20-a5b4-fcbfac6fc8ab None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:31.480610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f73c12e3-efd5-4e20-a5b4-fcbfac6fc8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:31.509019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 227/458] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:31.509019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b965-8d55-4447-af4f-71a6f4666a89 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:31.509019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b965-8d55-4447-af4f-71a6f4666a89 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:31.509019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b965-8d55-4447-af4f-71a6f4666a89 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:31.509390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 228/459] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:31.517852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe9596-c5f1-4e4b-9471-d35eb379f2ef None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:31.518308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe9596-c5f1-4e4b-9471-d35eb379f2ef None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:31.518522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efe9596-c5f1-4e4b-9471-d35eb379f2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:31.556556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9efe9596-c5f1-4e4b-9471-d35eb379f2ef None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:31.559066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9efe9596-c5f1-4e4b-9471-d35eb379f2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:31.590765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:31.602698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 232/460] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:31.654091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 229/461] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:31.825116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c12e3-efd5-4e20-a5b4-fcbfac6fc8ab None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:31.894251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:31.961609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73c12e3-efd5-4e20-a5b4-fcbfac6fc8ab None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:31.969489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe9596-c5f1-4e4b-9471-d35eb379f2ef None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.008751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb8dbf-bb77-4076-ae24-da9ddb23ff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.009388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb8dbf-bb77-4076-ae24-da9ddb23ff38 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.009670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb8dbf-bb77-4076-ae24-da9ddb23ff38 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.009976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb8dbf-bb77-4076-ae24-da9ddb23ff38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.023597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb8dbf-bb77-4076-ae24-da9ddb23ff38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.025338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb8dbf-bb77-4076-ae24-da9ddb23ff38 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-8eeb8dbf-bb77-4076-ae24-da9ddb23ff38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:32.043311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:32.044253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:32.045130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:32.045130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:32.045130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:32.047279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 233/462] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:32.049661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04fa7e-33b9-459c-95b6-10dfa7c6b1a1 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.050204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04fa7e-33b9-459c-95b6-10dfa7c6b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.050695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b04fa7e-33b9-459c-95b6-10dfa7c6b1a1 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.052397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 234/463] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:32.061084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46c2a9-482d-49a9-b3c9-364d6beee5e0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.061084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46c2a9-482d-49a9-b3c9-364d6beee5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.061084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f46c2a9-482d-49a9-b3c9-364d6beee5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.076785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4f46c2a9-482d-49a9-b3c9-364d6beee5e0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:32.078004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4f46c2a9-482d-49a9-b3c9-364d6beee5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:32.092118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efe9596-c5f1-4e4b-9471-d35eb379f2ef None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.129904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.130703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.130990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.131265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.141454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.143779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.154847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 235/464] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:32.156086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46c2a9-482d-49a9-b3c9-364d6beee5e0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:32.162865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:32.163733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:32.164569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:32.164569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:32.164569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:32.171305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 230/465] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:32.171305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.175895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:32.198105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:32.278783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f46c2a9-482d-49a9-b3c9-364d6beee5e0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.280071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b5afb-6310-403a-87ef-7cde632d1fbb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.315618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.316492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.316918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.317398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.318799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.319484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.319930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.320274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.321286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:32.321393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.322970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.330877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.332615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.348854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 236/466] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:32.348854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:32.352822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:32.353680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:32.354530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:32.354530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:32.354530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:32.356839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 231/467] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:32.357926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.418612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:32.456388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:32.468153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df01b53-3644-4735-bc97-550c5ea5d618 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.468283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233047c3-1a8f-4e83-b8a1-c9d2a4359752 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.504133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c17e9-9bc2-4972-901e-29d432787506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.504742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c17e9-9bc2-4972-901e-29d432787506 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.505026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c17e9-9bc2-4972-901e-29d432787506 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.505299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26c17e9-9bc2-4972-901e-29d432787506 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.505970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c17e9-9bc2-4972-901e-29d432787506 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.507412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26c17e9-9bc2-4972-901e-29d432787506 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.512549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.513170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.513458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.513736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.514402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:32.514715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.516220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.536278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 232/468] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:25:32 2022] POST /identity/v3/users => generated 248 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:32.536477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 237/469] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:32.536557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c17e9-9bc2-4972-901e-29d432787506 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.536655 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.670515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e655c4f5-b394-4c3f-b570-dc3f7303014a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.704272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26c17e9-9bc2-4972-901e-29d432787506 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.713422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.714459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.714747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.715027 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.716480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:32.729821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.731378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.747077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9847df-a85f-429d-8c18-304ddcef7dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.748039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9847df-a85f-429d-8c18-304ddcef7dba None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:32.748326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:32.749214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:32.750093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:32.750093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:32.750093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:32.750093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 238/470] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:32.750716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.751869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9847df-a85f-429d-8c18-304ddcef7dba None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.752408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9847df-a85f-429d-8c18-304ddcef7dba None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.753268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9847df-a85f-429d-8c18-304ddcef7dba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:32.753596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9847df-a85f-429d-8c18-304ddcef7dba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.755837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9847df-a85f-429d-8c18-304ddcef7dba None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.756674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:32.769867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 233/471] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:32.771167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee238a1-e8bf-42a7-9df7-50f9a5acd078 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.771434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee238a1-e8bf-42a7-9df7-50f9a5acd078 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.771718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee238a1-e8bf-42a7-9df7-50f9a5acd078 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.773170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 234/472] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:32.773906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee238a1-e8bf-42a7-9df7-50f9a5acd078 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.863016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce35e1-a9ac-4709-a8ed-6c0049e70c4c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.885393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee238a1-e8bf-42a7-9df7-50f9a5acd078 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:32.900339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caaa8e-7636-483d-8475-15133dfd91b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.900961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caaa8e-7636-483d-8475-15133dfd91b6 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.901247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caaa8e-7636-483d-8475-15133dfd91b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.901550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67caaa8e-7636-483d-8475-15133dfd91b6 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.902227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caaa8e-7636-483d-8475-15133dfd91b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.903690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67caaa8e-7636-483d-8475-15133dfd91b6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.923894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19063e-f5ec-40d1-b024-a01573ea9ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:32.924732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19063e-f5ec-40d1-b024-a01573ea9ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.925019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19063e-f5ec-40d1-b024-a01573ea9ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.925305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19063e-f5ec-40d1-b024-a01573ea9ee3 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.925987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19063e-f5ec-40d1-b024-a01573ea9ee3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:32.926329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19063e-f5ec-40d1-b024-a01573ea9ee3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:32.927747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19063e-f5ec-40d1-b024-a01573ea9ee3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:32.934175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 239/473] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:25:32 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:32.934175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caaa8e-7636-483d-8475-15133dfd91b6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:32.959597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 235/474] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:32.961277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907129a-ae3b-45d5-935b-b443985f639c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:32.961647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907129a-ae3b-45d5-935b-b443985f639c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:32.962027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907129a-ae3b-45d5-935b-b443985f639c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:32.983943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4907129a-ae3b-45d5-935b-b443985f639c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:32.985318 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4907129a-ae3b-45d5-935b-b443985f639c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:33.014357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:33.015312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:33.078378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 236/475] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:33.080296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907129a-ae3b-45d5-935b-b443985f639c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:33.082364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67caaa8e-7636-483d-8475-15133dfd91b6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:33.134032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ebb61-344e-4cc1-85e4-3396c50b3967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:33.134587 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ebb61-344e-4cc1-85e4-3396c50b3967 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:33.134875 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ebb61-344e-4cc1-85e4-3396c50b3967 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:33.135158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2ebb61-344e-4cc1-85e4-3396c50b3967 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:33.135807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ebb61-344e-4cc1-85e4-3396c50b3967 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:33.137288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2ebb61-344e-4cc1-85e4-3396c50b3967 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:33.171906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 240/476] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:25:32 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:33.223672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907129a-ae3b-45d5-935b-b443985f639c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:33.264667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a61c5-9206-439e-9464-dac05fd13a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:33.265285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a61c5-9206-439e-9464-dac05fd13a42 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:33.265573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a61c5-9206-439e-9464-dac05fd13a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:33.265852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a61c5-9206-439e-9464-dac05fd13a42 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:33.266601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a61c5-9206-439e-9464-dac05fd13a42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:33.268061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a61c5-9206-439e-9464-dac05fd13a42 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:33.299332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 237/477] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:25:33 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:33.378541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ebb61-344e-4cc1-85e4-3396c50b3967 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:33.502921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2ebb61-344e-4cc1-85e4-3396c50b3967 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:33.523182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:33.550360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:33.550995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:33.551276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:33.551551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:33.552224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:33.555714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:33.565022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.sql.core [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 00:25:33.565022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 00:25:33.565022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [parameters: {'id': 'e8fe59efc16043f285b723b0a1e8dc39', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 00:25:33.565022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81539) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application result.read() Aug 26 00:25:33.582214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return ref.to_dict() Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:25:33.583088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application yield resource Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise self.value Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application session.commit() Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:25:33.583988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:25:33.584817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:25:33.586437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application result.read() Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:25:33.588492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [parameters: {'id': 'e8fe59efc16043f285b723b0a1e8dc39', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:33.590799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 26 00:25:33.592780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:33.595319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 241/478] 10.222.0.88 () {60 vars in 1131 bytes} [Fri Aug 26 00:25:33 2022] POST /identity/v3/roles => generated 144 bytes in 206 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:33.595470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a61c5-9206-439e-9464-dac05fd13a42 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:33.620858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:33.712329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a61c5-9206-439e-9464-dac05fd13a42 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:33.755666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77574d5-d0f1-4160-84a6-ca19863967c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:33.756234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77574d5-d0f1-4160-84a6-ca19863967c7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:33.756521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77574d5-d0f1-4160-84a6-ca19863967c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:33.756804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77574d5-d0f1-4160-84a6-ca19863967c7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:33.779217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77574d5-d0f1-4160-84a6-ca19863967c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d77574d5-d0f1-4160-84a6-ca19863967c7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:33.786153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:33.787032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:33.787836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 238/479] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:25:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:33.793239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:33.949657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9f8f-7d70-4c60-923e-1485e04bd7d4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:33.998044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d930f564-bedd-4155-a140-4260edf91bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:33.998663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f564-bedd-4155-a140-4260edf91bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:33.998944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f564-bedd-4155-a140-4260edf91bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:33.999217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d930f564-bedd-4155-a140-4260edf91bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:33.999890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930f564-bedd-4155-a140-4260edf91bf2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:34.000191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930f564-bedd-4155-a140-4260edf91bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:34.001606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d930f564-bedd-4155-a140-4260edf91bf2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:34.013562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 242/480] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:34.757134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f1e3f-8358-4603-8291-5202f89ddefc None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:34.757688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f1e3f-8358-4603-8291-5202f89ddefc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:34.757688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f1e3f-8358-4603-8291-5202f89ddefc None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:34.759301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 239/481] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:34.764642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3befd-0087-40ae-b551-ea84a8906cd1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:34.765053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3befd-0087-40ae-b551-ea84a8906cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:34.765247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad3befd-0087-40ae-b551-ea84a8906cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:34.794068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cad3befd-0087-40ae-b551-ea84a8906cd1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:34.795283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cad3befd-0087-40ae-b551-ea84a8906cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:34.844752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:34.892787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 243/482] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:35.348445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f1e3f-8358-4603-8291-5202f89ddefc None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:35.456395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:35.491599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f1e3f-8358-4603-8291-5202f89ddefc None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:35.543481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40445f0a-f7a6-47b1-adda-8558b2b5db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:35.544118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445f0a-f7a6-47b1-adda-8558b2b5db4b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.544403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445f0a-f7a6-47b1-adda-8558b2b5db4b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.544681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40445f0a-f7a6-47b1-adda-8558b2b5db4b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.556526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40445f0a-f7a6-47b1-adda-8558b2b5db4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-40445f0a-f7a6-47b1-adda-8558b2b5db4b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:35.562052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:35.563138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:35.564996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 240/483] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:35.570820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3befd-0087-40ae-b551-ea84a8906cd1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:35.659874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da620-ba6a-40c0-8bdc-5a5ee7053f96 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.660170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da620-ba6a-40c0-8bdc-5a5ee7053f96 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.660351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932da620-ba6a-40c0-8bdc-5a5ee7053f96 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.669096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 241/484] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:35.675460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246b26-1461-492e-afe9-ba108ba60e23 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.675746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246b26-1461-492e-afe9-ba108ba60e23 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.676020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56246b26-1461-492e-afe9-ba108ba60e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.697412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-56246b26-1461-492e-afe9-ba108ba60e23 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:35.698671 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-56246b26-1461-492e-afe9-ba108ba60e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:35.724370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad3befd-0087-40ae-b551-ea84a8906cd1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:35.774095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a229739b-2491-43ce-977c-eca456686b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:35.774734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229739b-2491-43ce-977c-eca456686b09 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.774979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229739b-2491-43ce-977c-eca456686b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.775320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a229739b-2491-43ce-977c-eca456686b09 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.776162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229739b-2491-43ce-977c-eca456686b09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:35.776336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229739b-2491-43ce-977c-eca456686b09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:35.777712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a229739b-2491-43ce-977c-eca456686b09 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:35.786919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 242/485] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:35.794028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 244/486] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:35.794028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9d59-6d9d-466f-9d5b-3d07bb88e109 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.794028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9d59-6d9d-466f-9d5b-3d07bb88e109 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.794028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ea9d59-6d9d-466f-9d5b-3d07bb88e109 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.795391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 245/487] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:35.796597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56246b26-1461-492e-afe9-ba108ba60e23 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:35.796888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a530-991f-443f-aa36-405f9c47b543 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.797171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a530-991f-443f-aa36-405f9c47b543 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.797447 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4a530-991f-443f-aa36-405f9c47b543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.822946 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-21a4a530-991f-443f-aa36-405f9c47b543 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:35.824215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-21a4a530-991f-443f-aa36-405f9c47b543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:35.859372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:35.882814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:35.914472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 246/488] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:35.916004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e79e4-fcef-47a4-bc97-319fd4cc5f98 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.916466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e79e4-fcef-47a4-bc97-319fd4cc5f98 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.916812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e79e4-fcef-47a4-bc97-319fd4cc5f98 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.918615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 247/489] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:35.925405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871dc7f-9619-449b-9018-9c6af7db03f0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.925695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871dc7f-9619-449b-9018-9c6af7db03f0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.926081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871dc7f-9619-449b-9018-9c6af7db03f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.927633 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56246b26-1461-492e-afe9-ba108ba60e23 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:35.962964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f871dc7f-9619-449b-9018-9c6af7db03f0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:35.964250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f871dc7f-9619-449b-9018-9c6af7db03f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:35.964498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:35.965147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:35.965430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:35.965704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:35.978614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:35.980064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:36.002292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:36.003222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:36.004062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:36.004062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:36.004062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:36.004062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 243/490] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:36.009976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.091688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 248/491] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:36.092592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871dc7f-9619-449b-9018-9c6af7db03f0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.153662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c373a64-004a-4c8d-9590-df9c5f4df9ec None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.175284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:36.197504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.198476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.199134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.199635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.200486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:36.201032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:36.202821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:36.217943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 244/492] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:36.225584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.296417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:36.305252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871dc7f-9619-449b-9018-9c6af7db03f0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.345675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bd885-adf5-4b25-b58b-c76fbf2daada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.346728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bd885-adf5-4b25-b58b-c76fbf2daada None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.347157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bd885-adf5-4b25-b58b-c76fbf2daada None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.347666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bd885-adf5-4b25-b58b-c76fbf2daada None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.359178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035bd885-adf5-4b25-b58b-c76fbf2daada None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:36.362663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9db422-7781-46d8-9763-29fb856e1567 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-035bd885-adf5-4b25-b58b-c76fbf2daada None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:36.365178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:36.366295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:36.367302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:36.369191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 249/493] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:36.370128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bd885-adf5-4b25-b58b-c76fbf2daada None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.399297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.399997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.400210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.400479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.408723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:36.410324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:36.425471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:36.426599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 245/494] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:36.427518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.467780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:36.490071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bd885-adf5-4b25-b58b-c76fbf2daada None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.525020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c505860-2d70-4a3c-8e62-5790065c259d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.525645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c505860-2d70-4a3c-8e62-5790065c259d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.525959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c505860-2d70-4a3c-8e62-5790065c259d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.526236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c505860-2d70-4a3c-8e62-5790065c259d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.534253 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36fa0-2e52-4bb7-8dc8-c01ed085b85f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.538141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c505860-2d70-4a3c-8e62-5790065c259d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6c505860-2d70-4a3c-8e62-5790065c259d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:36.542836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:36.543700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:36.544523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 250/495] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:36.545167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c505860-2d70-4a3c-8e62-5790065c259d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.567659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:36.591990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.592916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.593395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.593827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.594618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:36.594927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:36.596313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:36.605094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 246/496] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:36.610104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.667313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c505860-2d70-4a3c-8e62-5790065c259d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.702334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673445-0950-4405-a06e-2f09fc7b7f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.702887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673445-0950-4405-a06e-2f09fc7b7f3e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.703172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673445-0950-4405-a06e-2f09fc7b7f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.703531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4673445-0950-4405-a06e-2f09fc7b7f3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.715239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4673445-0950-4405-a06e-2f09fc7b7f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:36.718183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f4673445-0950-4405-a06e-2f09fc7b7f3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:36.720257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:36.721125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:36.721936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 251/497] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:36.722594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d0279-03ed-4189-8637-38678e7104cd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.722669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673445-0950-4405-a06e-2f09fc7b7f3e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.758437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.759045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.759328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.759603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.760336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:36.760644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:36.762105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:36.799935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 247/498] 10.222.0.88 () {56 vars in 1137 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:36.800778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.802391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:36.828877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4673445-0950-4405-a06e-2f09fc7b7f3e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.871770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e86d96-133d-4c0c-8a8e-e06d00abe6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.872375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86d96-133d-4c0c-8a8e-e06d00abe6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.872654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86d96-133d-4c0c-8a8e-e06d00abe6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.872926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e86d96-133d-4c0c-8a8e-e06d00abe6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.873583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e86d96-133d-4c0c-8a8e-e06d00abe6c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:36.873913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e86d96-133d-4c0c-8a8e-e06d00abe6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:36.875284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e86d96-133d-4c0c-8a8e-e06d00abe6c2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:36.883838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 252/499] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:36.884995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab788d7e-84a2-4a90-8ac9-2b85290c03c4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.885280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab788d7e-84a2-4a90-8ac9-2b85290c03c4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.885554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab788d7e-84a2-4a90-8ac9-2b85290c03c4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.890049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 253/500] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:36.890049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab788d7e-84a2-4a90-8ac9-2b85290c03c4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.908497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1449fc9-96cc-4b4f-9205-467d78d6381f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:36.946989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:36.947644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:36.947935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:36.948220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:36.959031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:36.960585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:36.976250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:36.977183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:36.978529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:36.978529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:36.978529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:36.978529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 248/501] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:36.978529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:36.991060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:36.994992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab788d7e-84a2-4a90-8ac9-2b85290c03c4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.029750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.030415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.030695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.030969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.031632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:37.031939 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.033378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.035561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:37.043534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 254/502] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:37.044331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.087405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d841b9b-5ecf-4c8a-a18b-1c0673933105 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.122975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246105a-3353-4739-b5d6-db4ec22c6505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.123577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246105a-3353-4739-b5d6-db4ec22c6505 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.123858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246105a-3353-4739-b5d6-db4ec22c6505 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.124134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246105a-3353-4739-b5d6-db4ec22c6505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.144335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c204add-baba-4fc3-8029-5467bb28a85c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.180879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd048d38-d853-4b61-8134-3a2a9633961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.181504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd048d38-d853-4b61-8134-3a2a9633961c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.181784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd048d38-d853-4b61-8134-3a2a9633961c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.182081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd048d38-d853-4b61-8134-3a2a9633961c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.192036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246105a-3353-4739-b5d6-db4ec22c6505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.192370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd048d38-d853-4b61-8134-3a2a9633961c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.193503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246105a-3353-4739-b5d6-db4ec22c6505 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.193811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd048d38-d853-4b61-8134-3a2a9633961c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.204616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-cd048d38-d853-4b61-8134-3a2a9633961c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:37.209411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:37.210574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:37.211468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:37.211468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:37.211468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:37.211468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 255/503] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:37.211684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5e097-9e63-4aac-9630-35dc03a4c988 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.211975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5e097-9e63-4aac-9630-35dc03a4c988 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.212216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f5e097-9e63-4aac-9630-35dc03a4c988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.230253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e7f5e097-9e63-4aac-9630-35dc03a4c988 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:37.231479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e7f5e097-9e63-4aac-9630-35dc03a4c988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:37.278606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:37.296567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 249/504] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:37.297676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246105a-3353-4739-b5d6-db4ec22c6505 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.310158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 256/505] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:37.310158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5e097-9e63-4aac-9630-35dc03a4c988 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.403020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246105a-3353-4739-b5d6-db4ec22c6505 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.414316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:37.416050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f5e097-9e63-4aac-9630-35dc03a4c988 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.443166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.443772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.444063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.444337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.445048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:37.445296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.446702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.454689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.455718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.456183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.456640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.458361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 250/506] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:37.459159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.474043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.475601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:37.492551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:37.493442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:37.494309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:37.494309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:37.494309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:37.494309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 257/507] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:37.495007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.525481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:37.581578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148fbf5-e2a9-466b-827b-78d9d86f9bcc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.600509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9dcbe-e052-4f5d-8a41-f71e9a1231db None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.615476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.616083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.616367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.616644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.617291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:37.617590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.619009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.631608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 251/508] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:37.632701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.635058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.635687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.636240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.636240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.646962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.648438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:37.662808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:37.663725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:37.664552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:37.664552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:37.664552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:37.664731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:37.664803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 258/509] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:37.664803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.742422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b0dccd-8782-4204-b539-20661a07f8f5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.755033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:37.772699 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a9845-ed27-4c7c-a561-d8b0ce0ee7c7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.777022 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.777658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.777975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.778258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.786593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.788068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:37.799960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:37.806543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 252/510] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:37.807641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.809986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.810597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.810877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.811151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.811855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:37.812156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.813592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.826458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 259/511] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:37.827443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.895333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:37.905870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898a304-bca1-4eb1-ab88-20f39d7a7da7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.927707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad01dd1-f1b9-4d64-8d56-945d4aa1b0cb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:37.945086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.945723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.946045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.946326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.957030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.958551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.967815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:37.968446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:37.968730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:37.968999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:37.973490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:37.974392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:37.975244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:37.975244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:37.975244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:37.975244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 253/512] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:37.975745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:37.979144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:37.980625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:37.994392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:37.995262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:37.996329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 260/513] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:37.997245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.000585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:38.080608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2b2bdc-4957-4912-b278-912937417a74 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.096005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08523047-78f2-45c0-8597-984d44925c10 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.113834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.114466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.114750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.115027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.115669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:38.115975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.117367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.129279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 254/514] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:38.129939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.135637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.135978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:38.136338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.136627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.136902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.137645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:38.137990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.139631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.177384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 261/515] 10.222.0.88 () {56 vars in 1137 bytes} [Fri Aug 26 00:25:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:38.178257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.237762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca45a-3394-49bf-beb2-da983166e1c3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.238492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:38.271255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.271809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.272091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.272369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.276205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c5a1d1-c679-4b40-9f00-b45db55965d6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.279238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.280686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:38.292655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:38.293705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 255/516] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:38.294763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.315816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.316430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.316715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.316994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.317641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:38.317981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.319384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.331479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 262/517] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:38.332293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.359180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:38.399189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5de7d6-290c-4c9b-983a-ce31467cb1fa None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.432779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.433386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.433667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.433965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.434163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b2840-5275-4218-a16b-a53443162487 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.434700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:38.435008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.436441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.454149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 256/518] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:25:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:38.454966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.462001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:38.475644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.476292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.476580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.476954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.483988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.486206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:38.498122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:38.498975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:38.499864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 263/519] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:38.500330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.561847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365ff31-1bcf-43c2-932b-cce1797d4c23 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.584061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:38.598690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e8c6-c048-4669-8046-c54dedb03a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.599300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e8c6-c048-4669-8046-c54dedb03a23 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.599582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e8c6-c048-4669-8046-c54dedb03a23 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.599856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e8c6-c048-4669-8046-c54dedb03a23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.607156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33f2dc-6339-4bf1-9356-2e79a31f8641 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.655811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.656421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.656708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.657178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.658506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:38.659040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.661621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.681323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191e8c6-c048-4669-8046-c54dedb03a23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.682330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 264/520] 10.222.0.88 () {56 vars in 1139 bytes} [Fri Aug 26 00:25:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:38.682837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191e8c6-c048-4669-8046-c54dedb03a23 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.683174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.729546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:38.799375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 257/521] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:38.800532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e8c6-c048-4669-8046-c54dedb03a23 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.804676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caea7dc-ca7f-48c1-bba2-ab3f23678813 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.822898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:38.850513 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e5edf-b879-4dd8-b854-15da7c3a1752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.851259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5edf-b879-4dd8-b854-15da7c3a1752 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.851630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5edf-b879-4dd8-b854-15da7c3a1752 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.852047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992e5edf-b879-4dd8-b854-15da7c3a1752 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:38.852812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e5edf-b879-4dd8-b854-15da7c3a1752 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:38.854489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992e5edf-b879-4dd8-b854-15da7c3a1752 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:38.884916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 265/522] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:25:38 2022] POST /identity/v3/users => generated 247 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:38.885894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e5edf-b879-4dd8-b854-15da7c3a1752 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:38.923527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e8c6-c048-4669-8046-c54dedb03a23 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:38.963609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753dff7-8d9c-4212-b4d2-2c4c6c13c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:38.964309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753dff7-8d9c-4212-b4d2-2c4c6c13c13e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:38.964619 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753dff7-8d9c-4212-b4d2-2c4c6c13c13e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:38.964894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753dff7-8d9c-4212-b4d2-2c4c6c13c13e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.045082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:39.050850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753dff7-8d9c-4212-b4d2-2c4c6c13c13e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.052336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753dff7-8d9c-4212-b4d2-2c4c6c13c13e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.056652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992e5edf-b879-4dd8-b854-15da7c3a1752 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:39.076916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:39.103137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:39.103761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:39.104048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:39.104329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.105047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:39.105356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.107002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.125297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 266/523] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:39.126783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:39.194571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 258/524] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:39.195223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753dff7-8d9c-4212-b4d2-2c4c6c13c13e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:39.253381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80561d7e-0774-46df-b2b7-914ffbf194b5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:39.293021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d23ecf-51d0-4574-9067-3706da380a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:39.294736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d23ecf-51d0-4574-9067-3706da380a15 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:39.295247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d23ecf-51d0-4574-9067-3706da380a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:39.295945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d23ecf-51d0-4574-9067-3706da380a15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.312201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753dff7-8d9c-4212-b4d2-2c4c6c13c13e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:39.329261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:39.339710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:39.358526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:39.359179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:39.359468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:39.359742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.374142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.377268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.386849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d23ecf-51d0-4574-9067-3706da380a15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.389368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d23ecf-51d0-4574-9067-3706da380a15 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:39.396078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:39.396976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:39.397835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:39.397835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:39.397835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:39.397835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 259/525] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:39.398538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:39.506045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 267/526] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:39.506956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d23ecf-51d0-4574-9067-3706da380a15 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:39.520026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897e1a53-6bdd-4da5-a571-be2d7a489a8f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:39.558381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:39.559483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:39.559977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:39.560446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.561376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=2be2cb98356b4d628408d094589a83e4) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:39.561760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.563529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.577925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 260/527] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/role_assignments?user.id=2be2cb98356b4d628408d094589a83e4&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:39.577925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:39.583620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:39.630290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:39.643273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d23ecf-51d0-4574-9067-3706da380a15 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:39.692884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:39.693801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:39.694466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:39.695396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.708352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.710061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.720869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86e1bd9-1b24-42bf-9e12-bc45ff73e604 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:39.733312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:39.734634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:39.736391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:39.736391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:39.736391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:39.736391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 268/528] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:39.736737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:39.770960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:39.772079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:39.772535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:39.773306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.774422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:39.774899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.777575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.800376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 261/529] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:39.800376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:39.874639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80968601-92f3-4d7c-a434-a261c02efa71 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:39.886689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:39.912372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:39.920289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a584f-56cb-4ee1-b075-a0a18e1e78a9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:39.921162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:39.922090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:39.922379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:39.922697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.935723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.937820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:39.958499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:39.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:39.960680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:39.960680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:39.960680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:39.962385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 269/530] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:39.963669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:39.973328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:39.974203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:39.974711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:39.975137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:39.976442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:39.976894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:39.979777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:39.995428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 262/531] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:39.996494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.105262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba10af2-8f20-47c1-bcc3-93230db9f445 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.123902 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb7812-f91e-4972-ae8e-6bbea6aa1d3d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.153515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.154721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.155209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.155878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.161380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.162289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.162654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.163023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.163751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:40.164123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.165603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.165725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:40.167683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:40.179886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 263/532] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:40.180945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:40.185801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:40.187064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:40.188924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:40.188924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:40.188924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:40.188924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:40.188924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:40.188924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:40.188924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:40.188924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:40.192517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 270/533] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:40.193562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.204504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:40.229828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:40.295887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e4a3ef-a0ec-4aed-80bb-867d226602e9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.334835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e5b3a-2bd6-4683-859d-1f257831ddcb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.343838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.345129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.345529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.345987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.353732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.355527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:40.369623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:40.370515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:40.371331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:40.371331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:40.371331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:40.371331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:40.371331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:40.371331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:40.371331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:40.371331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:40.374177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 264/534] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:40.375707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.382920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.383820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.384292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.384737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.393580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.395909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:40.410950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:40.411796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:40.412621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:40.412621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:40.412621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:40.412621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:40.412621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:40.412621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:40.412621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:40.412621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:40.414974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 271/535] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:40.415921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.478791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:40.510905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b69bf5-b3f6-43b8-b3c5-03a726bb061f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.524561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:40.556820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e69f92-35d7-4c2b-ad23-5dcdbe5734bc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.561102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.562071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.562573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.563091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.564189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:40.564760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.566564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:40.590083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 265/536] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:40.591377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.601457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.602113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.602395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.602670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.604082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:40.604412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.605906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:40.625814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 272/537] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:40.626792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.721138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9c7cd8-38d5-410d-885f-76932c544015 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.738898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d7b21-9490-47a4-8eca-5c4fea3eb4e2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.761614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.762613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.763098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.763674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.764676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:40.765227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.767549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:40.772475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:40.775588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.776296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.776679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.777049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.777911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=a0d14a63f09046efb6d5c2533f6d3609) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:40.778333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.780059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:40.784577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 266/538] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:40.793929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 273/539] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:40 2022] GET /identity/v3/role_assignments?user.id=a0d14a63f09046efb6d5c2533f6d3609&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:40.793929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.794684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:40.812028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:40.912105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b98967-8e73-4c51-a064-ae541b193d13 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:40.989652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf71fe-2f4b-405b-b5a1-94d5c9e96210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:40.990337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf71fe-2f4b-405b-b5a1-94d5c9e96210 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:40.990624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf71fe-2f4b-405b-b5a1-94d5c9e96210 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:40.990902 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf71fe-2f4b-405b-b5a1-94d5c9e96210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:40.991654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf71fe-2f4b-405b-b5a1-94d5c9e96210 None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=81ac50ea01de4a9d9b76befbcba88845) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:40.991971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf71fe-2f4b-405b-b5a1-94d5c9e96210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:40.993440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf71fe-2f4b-405b-b5a1-94d5c9e96210 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:41.002739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 267/540] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:40 2022] GET /identity/v3/role_assignments?user.id=81ac50ea01de4a9d9b76befbcba88845&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:41.003871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb9717-57e5-4e6b-9fb5-994ac5f550d5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:41.004230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb9717-57e5-4e6b-9fb5-994ac5f550d5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:41.004603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb9717-57e5-4e6b-9fb5-994ac5f550d5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:41.011854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 268/541] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:41.012757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee225dd-f17d-4b9d-8a28-7185f2be52b5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:41.013044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee225dd-f17d-4b9d-8a28-7185f2be52b5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:41.013318 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee225dd-f17d-4b9d-8a28-7185f2be52b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:41.037829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6ee225dd-f17d-4b9d-8a28-7185f2be52b5 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:41.039364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6ee225dd-f17d-4b9d-8a28-7185f2be52b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:41.044329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5c549-b9aa-46de-9b9c-70d48d4bad78 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:41.098318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:41.099874 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:41.100791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:41.101277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:41.102589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=a0e9262597de4799a64977e44b41e6aa) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:41.103406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:41.105969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:41.115416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 274/542] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:40 2022] GET /identity/v3/role_assignments?user.id=a0e9262597de4799a64977e44b41e6aa&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 259 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:41.116365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:41.141361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 269/543] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:41.466086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:41.558617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:41.598366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf2cb5e-c6f1-4f2c-9ac4-ec56befc5004 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:41.634921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6669dbe4-ba85-4b75-8a20-20adb092b294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:41.635583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669dbe4-ba85-4b75-8a20-20adb092b294 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:41.635865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669dbe4-ba85-4b75-8a20-20adb092b294 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:41.636138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6669dbe4-ba85-4b75-8a20-20adb092b294 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:41.648573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6669dbe4-ba85-4b75-8a20-20adb092b294 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6669dbe4-ba85-4b75-8a20-20adb092b294 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:41.653754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:41.654641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:41.655558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 275/544] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:41.663270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee225dd-f17d-4b9d-8a28-7185f2be52b5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:41.778247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29fc7-df8a-47db-be60-1365cc3a0717 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:41.778453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29fc7-df8a-47db-be60-1365cc3a0717 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:41.778970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb29fc7-df8a-47db-be60-1365cc3a0717 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:41.780287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 276/545] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:41.785338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee225dd-f17d-4b9d-8a28-7185f2be52b5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:41.785559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862049-a4bd-4f52-a974-39c053f5cae6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:41.785851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862049-a4bd-4f52-a974-39c053f5cae6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:41.786173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8862049-a4bd-4f52-a974-39c053f5cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:41.805640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e8862049-a4bd-4f52-a974-39c053f5cae6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:41.806894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e8862049-a4bd-4f52-a974-39c053f5cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:41.831801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:41.832664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:41.833087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:41.833525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:41.834643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:41.835359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:41.837584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:41.852937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 270/546] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:41.861140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:41.940762 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 277/547] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:41.950004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:42.050431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9543c0-31f1-457b-926b-962969a5d1fb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:42.085912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:42.086552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:42.086833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:42.087102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:42.099517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:42.101021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:42.115433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:42.116328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:42.117326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:42.117326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:42.117326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:42.117326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 271/548] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:42.122444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862049-a4bd-4f52-a974-39c053f5cae6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:42.187211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:42.230159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8862049-a4bd-4f52-a974-39c053f5cae6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:42.265788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:42.266454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:42.266749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:42.267051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:42.267697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:42.268001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:42.269371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:42.281072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 278/549] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:42.286287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:42.318826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:42.465845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f30e486-83e0-48ad-bca0-92da0c2553c5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:42.468028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290cde8f-4e33-4f5b-b8fd-ab55d79e4a90 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:42.468849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:42.504732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:42.505762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:42.506294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:42.506803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:42.511287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:42.516144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:42.518488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:42.533141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:42.534807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:25:42.535865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:42.538299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 272/550] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:25:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:42.544026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:42.587220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cced2a-3a1c-44ed-b19f-e005e6057b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:42.587880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cced2a-3a1c-44ed-b19f-e005e6057b38 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:42.588165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cced2a-3a1c-44ed-b19f-e005e6057b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:42.588456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cced2a-3a1c-44ed-b19f-e005e6057b38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:42.622798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cced2a-3a1c-44ed-b19f-e005e6057b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c1cced2a-3a1c-44ed-b19f-e005e6057b38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:42.628295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:42.629212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:42.630217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 279/551] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:42.655605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cced2a-3a1c-44ed-b19f-e005e6057b38 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:42.683931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb43e8f-ae0a-4b8d-87d9-5d149cd3a3a9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:42.753748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:42.754392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:42.754678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:42.754946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:42.755679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:42.755986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:42.757420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:42.790505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 273/552] 10.222.0.88 () {56 vars in 1135 bytes} [Fri Aug 26 00:25:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:42.800101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:42.825710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cced2a-3a1c-44ed-b19f-e005e6057b38 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:42.857252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:42.865905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:42.866543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:42.866842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:42.867101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:42.867776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:42.868085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:42.869463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:42.878426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 280/553] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:42.883966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:42.933304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:43.002119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929fba00-e667-4ed0-b3b4-50b1a119d19c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:43.038845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:43.039493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.039776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.040053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.066536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:43.069276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:43.074821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f699042-832b-43d4-bfd7-6f2ce26fcbf6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:43.091397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:43.092347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:43.093213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:43.093213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:43.093213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:43.093213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 281/554] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:43.100161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:43.148466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb074b45-41d4-4a5a-8f94-dbf400633a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:43.149085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb074b45-41d4-4a5a-8f94-dbf400633a9c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.149369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb074b45-41d4-4a5a-8f94-dbf400633a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.149647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb074b45-41d4-4a5a-8f94-dbf400633a9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.224067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb074b45-41d4-4a5a-8f94-dbf400633a9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:43.224292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:43.226414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb074b45-41d4-4a5a-8f94-dbf400633a9c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:43.234257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3728a-7dc7-44df-ab86-31d1abfaada5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:43.253054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:43.272826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a1504-c2bf-4be7-8922-4f03e32cff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:43.273490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1504-c2bf-4be7-8922-4f03e32cff78 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.273776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1504-c2bf-4be7-8922-4f03e32cff78 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.274079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a1504-c2bf-4be7-8922-4f03e32cff78 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.274728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a1504-c2bf-4be7-8922-4f03e32cff78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:43.275033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a1504-c2bf-4be7-8922-4f03e32cff78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:43.276509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a1504-c2bf-4be7-8922-4f03e32cff78 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:43.290726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 282/555] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:43.292996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c51c2-01be-4456-b41b-e35a19e98210 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.293114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c51c2-01be-4456-b41b-e35a19e98210 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.293393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13c51c2-01be-4456-b41b-e35a19e98210 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.299703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 283/556] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:43.300753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c51c2-01be-4456-b41b-e35a19e98210 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:43.347355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 274/557] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:25:43.349011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c59bf-14bd-4a81-97d5-fed0975710eb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.349494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c59bf-14bd-4a81-97d5-fed0975710eb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.350114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c59bf-14bd-4a81-97d5-fed0975710eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.370715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-931c59bf-14bd-4a81-97d5-fed0975710eb None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:43.372292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-931c59bf-14bd-4a81-97d5-fed0975710eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:43.416482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13c51c2-01be-4456-b41b-e35a19e98210 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:43.448342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 275/558] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:43.449666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c59bf-14bd-4a81-97d5-fed0975710eb None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:43.457545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:43.458220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.458706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.458856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.467068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:43.468718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:43.482149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:43.483115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:43.484022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 284/559] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:43 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:43.502077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:43.521642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:43.542823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:43.601389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c59bf-14bd-4a81-97d5-fed0975710eb None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:43.630072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9769e35-acf0-46de-99ef-a49dd2b7af84 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:43.636747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6ceff-009b-421b-8a18-21aa222a1ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:43.637377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ceff-009b-421b-8a18-21aa222a1ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.637656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ceff-009b-421b-8a18-21aa222a1ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.637966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6ceff-009b-421b-8a18-21aa222a1ea4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.648238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ceff-009b-421b-8a18-21aa222a1ea4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:43.649672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b6ceff-009b-421b-8a18-21aa222a1ea4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-57b6ceff-009b-421b-8a18-21aa222a1ea4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:43.664200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:43.665126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:43.666010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:43.666010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:43.666010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:43.666010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 276/560] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:43.666531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e806964-34ab-484b-8030-5c0515124209 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.666787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e806964-34ab-484b-8030-5c0515124209 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.667062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e806964-34ab-484b-8030-5c0515124209 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.668445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 277/561] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:43.671008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707600b8-8346-455d-bcf5-fdfd6aa235f5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.672031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707600b8-8346-455d-bcf5-fdfd6aa235f5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.673987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707600b8-8346-455d-bcf5-fdfd6aa235f5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.674921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c70950-56b2-40f8-a42b-08bb1729346b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:43.675540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70950-56b2-40f8-a42b-08bb1729346b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.675826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70950-56b2-40f8-a42b-08bb1729346b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.676102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c70950-56b2-40f8-a42b-08bb1729346b None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.676301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 278/562] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:43.676844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70950-56b2-40f8-a42b-08bb1729346b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:43.677151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70950-56b2-40f8-a42b-08bb1729346b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:43.677503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707600b8-8346-455d-bcf5-fdfd6aa235f5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:43.678745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c70950-56b2-40f8-a42b-08bb1729346b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:43.703006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 285/563] 10.222.0.88 () {56 vars in 1137 bytes} [Fri Aug 26 00:25:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:43.703006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212fdd-265b-4a31-9fa3-f15bb9d8da92 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.703006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212fdd-265b-4a31-9fa3-f15bb9d8da92 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.703006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74212fdd-265b-4a31-9fa3-f15bb9d8da92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.720617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-74212fdd-265b-4a31-9fa3-f15bb9d8da92 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:43.721818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-74212fdd-265b-4a31-9fa3-f15bb9d8da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:43.795295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:43.798610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707600b8-8346-455d-bcf5-fdfd6aa235f5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:43.800725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 286/564] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:43.801736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:43.801999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d90f-fd47-453f-b295-ac9e71860cde None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.802461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d90f-fd47-453f-b295-ac9e71860cde None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.802845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53d90f-fd47-453f-b295-ac9e71860cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.825388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7e53d90f-fd47-453f-b295-ac9e71860cde None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:43.826612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7e53d90f-fd47-453f-b295-ac9e71860cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:43.842480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:43.843130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:43.843369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:43.843645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:43.844550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:43.845261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:43.846555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:43.860248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 279/565] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:43.861223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:43.906249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 287/566] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:43.907618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53d90f-fd47-453f-b295-ac9e71860cde None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:43.997037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a7747-0dad-408f-90f9-987c4ee866dd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.044525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.045527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.046051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.046255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53d90f-fd47-453f-b295-ac9e71860cde None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.046733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.063334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.066252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:44.083471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:44.084875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:44.085762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:44.085762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:44.085762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:44.085762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 280/567] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:44.090882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.095357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:44.104266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265a6e-ce3b-4bb8-bab7-04e7a3180f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.105063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265a6e-ce3b-4bb8-bab7-04e7a3180f3d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.105345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265a6e-ce3b-4bb8-bab7-04e7a3180f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.106046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec265a6e-ce3b-4bb8-bab7-04e7a3180f3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.108011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:44.120548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec265a6e-ce3b-4bb8-bab7-04e7a3180f3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ec265a6e-ce3b-4bb8-bab7-04e7a3180f3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:44.127068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:44.127983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:44.128834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 288/568] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:44.129512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265a6e-ce3b-4bb8-bab7-04e7a3180f3d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.216754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ffe358-b0fa-43db-a2f9-a1d5468ee6dc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.243528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec265a6e-ce3b-4bb8-bab7-04e7a3180f3d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.259301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.260189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.260650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.261113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.269463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.271010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.285027 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1cd3f-4ab4-44e3-a4ec-3fcfa2a55048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:44.285254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:44.286123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:44.287010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:44.287010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:44.287010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:44.287010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:44.287010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:44.287010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:44.287010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:44.287010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:44.287431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1cd3f-4ab4-44e3-a4ec-3fcfa2a55048 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.287431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1cd3f-4ab4-44e3-a4ec-3fcfa2a55048 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.287431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d1cd3f-4ab4-44e3-a4ec-3fcfa2a55048 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.287619 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 281/569] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:44.287619 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.301452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d1cd3f-4ab4-44e3-a4ec-3fcfa2a55048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e2d1cd3f-4ab4-44e3-a4ec-3fcfa2a55048 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:44.306541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:44.307475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:44.308378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 289/570] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:44.309048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1cd3f-4ab4-44e3-a4ec-3fcfa2a55048 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.363187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:44.380620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:44.414709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c058e9-8614-494a-9cee-7827e4dcb812 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.419165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d1cd3f-4ab4-44e3-a4ec-3fcfa2a55048 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.451524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.452165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.452472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.452750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.453405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:44.453739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.455269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.459389 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.460006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.460280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.460554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.461219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:44.461523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.462962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.467708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 282/571] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:44.468560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.476256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 290/572] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:44.477114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.599045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fea78-6f02-4ec4-8b53-539302da4aae None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.600007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956e551-1a4a-4d94-bed5-904ef84985c0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.614470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:44.637447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b12570-50ae-4fb5-997a-41f60ea122b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.638019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12570-50ae-4fb5-997a-41f60ea122b5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.638303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12570-50ae-4fb5-997a-41f60ea122b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.638577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b12570-50ae-4fb5-997a-41f60ea122b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.639707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.640321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.640607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.640891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.641996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:44.642609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:44.642935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.644421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.650982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b12570-50ae-4fb5-997a-41f60ea122b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-98b12570-50ae-4fb5-997a-41f60ea122b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:44.655753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:44.657284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:44.658846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:44.659479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 291/573] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:44.659551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 283/574] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:44.659617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.659693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b12570-50ae-4fb5-997a-41f60ea122b5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.765236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b12570-50ae-4fb5-997a-41f60ea122b5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.770988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733a3d75-0d15-44e7-8cd7-a729144789d1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.804790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.805418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.805699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.806151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.808776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.809383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.809668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.809984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.810653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:44.810963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.812350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.812577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.814087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.820698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 292/575] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:44.821494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:44.825008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:44.826211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 284/576] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:44.827356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.858082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:44.883650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:44.925723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f3843-4f02-4c6b-84f1-71be1123f1e2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.927171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3dc7fc-d056-4cc9-a779-a011610cfbde None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:44.958545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.959215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.959504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.959775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.960020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:44.960630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:44.960917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:44.961194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:44.961962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=c266ac5c785d46488a1a1560283ba4fa) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:44.962281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.963715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.969547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 285/577] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/role_assignments?user.id=c266ac5c785d46488a1a1560283ba4fa&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:44.970632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:44.971193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:44.972509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:44.990030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:44.991036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:44.991906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:44.991906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:44.991906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:44.991906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 293/578] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:44.992127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.090574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a6785-9e88-42c6-9e77-03ecfb758f8f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.099663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:45.115047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:45.122980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db12e18-8dfb-4cdc-b4cc-cb7688f7525e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.131700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.132315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.132604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.132884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.133554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:45.133863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.135258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.148706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 286/579] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:45.148706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.164814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.165547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.165923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.166264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.177179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.178782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:45.193400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:45.194577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:45.195646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:45.195646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:45.195646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:45.196310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 294/580] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:45.196885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.261521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb85837d-e2b2-4543-b80f-186c16e91872 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.298377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.299021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.299305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.299586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.300290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:45.300601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.301856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21fb73-ea6f-4ea5-b0ab-3aa6a56b84c3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.302339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.319906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 287/581] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:45.319906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.345474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.346108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.346391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.346696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.347299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:45.347601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.349060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.356780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:45.363976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:45.364608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 295/582] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:45.365358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.431552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e4d31-1790-420d-a8e0-1fe2edc94fee None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.468258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.468898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.469839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.470147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.477099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4932fa6c-5ed4-4fab-a558-2b8608acaccf None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.480643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.482113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:45.498764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:45.499920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:45.500876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:45.500876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:45.500876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:45.500876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 288/583] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:45.500876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.523619 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760d97-4578-4977-a176-34728edc9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.524381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760d97-4578-4977-a176-34728edc9918 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.524665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760d97-4578-4977-a176-34728edc9918 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.524937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86760d97-4578-4977-a176-34728edc9918 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.525572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86760d97-4578-4977-a176-34728edc9918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:45.525909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86760d97-4578-4977-a176-34728edc9918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.527558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86760d97-4578-4977-a176-34728edc9918 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.544310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 296/584] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:45.544310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760d97-4578-4977-a176-34728edc9918 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.611503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:45.618874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f40bf76-fd53-44e6-ba6c-5649dea553de None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.622131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:45.658583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e47ad-301e-4df7-a812-d9bd073a153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.659251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e47ad-301e-4df7-a812-d9bd073a153d None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.659537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e47ad-301e-4df7-a812-d9bd073a153d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.659833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e47ad-301e-4df7-a812-d9bd073a153d None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/2be2cb98356b4d628408d094589a83e4/roles/b488fca06c5144f48db762c7a2ab776b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.668027 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86760d97-4578-4977-a176-34728edc9918 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.675145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e47ad-301e-4df7-a812-d9bd073a153d None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=2be2cb98356b4d628408d094589a83e4, role_id=b488fca06c5144f48db762c7a2ab776b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.676587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e47ad-301e-4df7-a812-d9bd073a153d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.698204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 289/585] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:25:45 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/2be2cb98356b4d628408d094589a83e4/roles/b488fca06c5144f48db762c7a2ab776b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:45.699129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e47ad-301e-4df7-a812-d9bd073a153d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.704861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.705516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.705804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.706126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.715018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.716520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:45.730570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:45.731557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:25:45.732504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:45.737533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 297/586] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:45.738525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.865018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c563-f105-4d62-9056-e9333b42b157 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.871532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e47ad-301e-4df7-a812-d9bd073a153d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:45.887972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:45.908429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.909209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.909595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.910002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.918363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.919983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.920918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:45.921692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:45.922988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:45.923416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:45.924756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:45.925214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:45.926746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:45.933493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:45.934697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:25:45.935850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:45.942017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 298/587] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:45.943054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.944142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 290/588] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:45.945925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:45.950931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.061228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7414b0-62c0-4ab2-a377-b25b882f30ef None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.079187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59a7bf-8e02-41b8-bd6d-488c014d3723 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.103159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.103989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.104447 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.104846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.105786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:46.106274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.107810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.119958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.121103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.121528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.121964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.122841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:46.123307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.124901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.128490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 299/589] 10.222.0.88 () {56 vars in 1137 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:46.129425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.145084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 291/590] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:25:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:46.146287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.174454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.213374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.252869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f549a4-0c41-4ae7-8501-f1fccb4f06a4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.254897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942d88e-5e06-48f2-9709-9da707094638 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.291683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.291929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.292658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.292913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.293126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.293505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.293614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.294029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.302271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.303980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.306415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.308014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:46.317753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:46.318723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:46.319620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 300/591] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:46.320975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:46.327809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:46.329311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:46.330441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:46.330441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:46.330441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:46.332548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 292/592] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:46.333582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.430770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.435992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53657c-5434-45b9-b121-b38746c959e8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.439746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f4616-7d5f-4b65-bb55-7733304da087 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.451254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.478144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.478915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.479389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.479847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.480788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:46.481190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.481436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.482247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.482672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.483042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.483239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.495357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.497002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.502227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 293/593] 10.222.0.88 () {56 vars in 1139 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:46.503174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:46.514474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:46.515520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:46.517049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:46.517049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:46.517049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:46.518601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 301/594] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:46.519732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.611736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f35f51-f34c-4d03-b086-c52a4b7b4981 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.636281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826cb9a-c25b-4404-aacb-59e47e0c83fd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.647559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.648326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.648704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.649322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.649819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:46.650239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.651692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.664118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 294/595] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:46.664873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.677465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.678370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.678859 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.679358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.692398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.694105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.701374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.705621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:46.713005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:46.714123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:46.715088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:46.715088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:46.715088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:46.717626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 302/596] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:46.718684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.803941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643de8b3-f380-4db2-bb19-35687e92fe5c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.837401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c89c64-e7f2-43d7-b5b9-b7e6b21eb845 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:46.852403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.853021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.853305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.853584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.854768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:46.855080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.856722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.871623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 295/597] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:46.872570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.877431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:46.878490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:46.878987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:46.879469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:46.887926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:46.890045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:46.903353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:46.904355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:46.905226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:46.905226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:46.905226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:46.905226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:46.905226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:46.905226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:46.905226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:46.905226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:46.908508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 303/598] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:46.909636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:46.975188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.980537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:46.990578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a577471-1ed1-417c-b14c-ec1f134c60fa None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.024171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e23ea2-ead4-470b-976f-431acf5a8d0d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.024374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.024969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.025249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.025521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.026199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:47.026506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.027865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.044862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 296/599] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:47.044862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:47.067857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6241-02b0-4220-8cb3-a78adff5747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.068421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6241-02b0-4220-8cb3-a78adff5747b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.068707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6241-02b0-4220-8cb3-a78adff5747b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.068982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6241-02b0-4220-8cb3-a78adff5747b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.076342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b6241-02b0-4220-8cb3-a78adff5747b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.077987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b6241-02b0-4220-8cb3-a78adff5747b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e08b6241-02b0-4220-8cb3-a78adff5747b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:47.089834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:47.090747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:47.091622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 304/600] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:47.092557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae7ef-86e1-446a-aad0-0bdcaccc5bb7 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.092557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae7ef-86e1-446a-aad0-0bdcaccc5bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.092722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbae7ef-86e1-446a-aad0-0bdcaccc5bb7 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.094617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 305/601] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:47.095558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbae7ef-86e1-446a-aad0-0bdcaccc5bb7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:47.158494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38295336-a3de-410b-8b64-5b2bdc4b37f3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.192935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.193545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.193829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.194133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.194832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:47.195141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.196571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.208832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 297/602] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:47.209692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:47.210651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbae7ef-86e1-446a-aad0-0bdcaccc5bb7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.229656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:47.240587 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:47.256324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ae2779-c692-4502-a3af-c406c7e436da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.257075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2779-c692-4502-a3af-c406c7e436da None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.257358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2779-c692-4502-a3af-c406c7e436da None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.257639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ae2779-c692-4502-a3af-c406c7e436da None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.266845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2779-c692-4502-a3af-c406c7e436da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.268376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ae2779-c692-4502-a3af-c406c7e436da None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-38ae2779-c692-4502-a3af-c406c7e436da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:47.280157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:47.281136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:47.282577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 306/603] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:47.283055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea6ca-8438-43ab-9400-a1dbb79b6dd2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.283608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea6ca-8438-43ab-9400-a1dbb79b6dd2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.283608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106ea6ca-8438-43ab-9400-a1dbb79b6dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.302591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-106ea6ca-8438-43ab-9400-a1dbb79b6dd2 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:47.303807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-106ea6ca-8438-43ab-9400-a1dbb79b6dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:47.346000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e56695-5373-4f09-85ab-a94bcf681980 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.387504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.388129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.388413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.388691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.389391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:47.389724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.391703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.394296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 307/604] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:47.395103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea6ca-8438-43ab-9400-a1dbb79b6dd2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:47.409729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 298/605] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:47.411051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:47.511023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:47.535324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106ea6ca-8438-43ab-9400-a1dbb79b6dd2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.548064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:47.560610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d006a3fc-840a-4ecf-bac2-1923fb82e570 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.589171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3fe63-7914-4b78-95a7-4f71a59b5c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.590426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3fe63-7914-4b78-95a7-4f71a59b5c60 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.591227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3fe63-7914-4b78-95a7-4f71a59b5c60 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.591976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3fe63-7914-4b78-95a7-4f71a59b5c60 None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/a0d14a63f09046efb6d5c2533f6d3609/roles/b488fca06c5144f48db762c7a2ab776b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.608522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.609188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3fe63-7914-4b78-95a7-4f71a59b5c60 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=a0d14a63f09046efb6d5c2533f6d3609, role_id=b488fca06c5144f48db762c7a2ab776b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.609746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.610264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.610740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.611003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3fe63-7914-4b78-95a7-4f71a59b5c60 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.611878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:47.612395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.614809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.628914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 299/606] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:47.630061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:47.630711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 308/607] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:25:47 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/a0d14a63f09046efb6d5c2533f6d3609/roles/b488fca06c5144f48db762c7a2ab776b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:47.638191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3fe63-7914-4b78-95a7-4f71a59b5c60 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:47.780470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a52f00-69ac-438b-b79f-add7ef40f466 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.781041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3fe63-7914-4b78-95a7-4f71a59b5c60 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:47.823234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:47.823724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174ffeb-199f-4460-a235-2306b8ed176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.824406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174ffeb-199f-4460-a235-2306b8ed176f None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.825074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174ffeb-199f-4460-a235-2306b8ed176f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.825362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174ffeb-199f-4460-a235-2306b8ed176f None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/a0e9262597de4799a64977e44b41e6aa/roles/b488fca06c5144f48db762c7a2ab776b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.829088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0d9f-fccb-465e-add8-84ba6e77747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:47.829835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0d9f-fccb-465e-add8-84ba6e77747e None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.830136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0d9f-fccb-465e-add8-84ba6e77747e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.830425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0d9f-fccb-465e-add8-84ba6e77747e None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/81ac50ea01de4a9d9b76befbcba88845/roles/b488fca06c5144f48db762c7a2ab776b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.842463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174ffeb-199f-4460-a235-2306b8ed176f None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=a0e9262597de4799a64977e44b41e6aa, role_id=b488fca06c5144f48db762c7a2ab776b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.844469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174ffeb-199f-4460-a235-2306b8ed176f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.849732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b0d9f-fccb-465e-add8-84ba6e77747e None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=81ac50ea01de4a9d9b76befbcba88845, role_id=b488fca06c5144f48db762c7a2ab776b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:47.851353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b0d9f-fccb-465e-add8-84ba6e77747e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:47.862309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 309/608] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:25:47 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/a0e9262597de4799a64977e44b41e6aa/roles/b488fca06c5144f48db762c7a2ab776b => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:25:47.870147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 300/609] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:25:47 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/81ac50ea01de4a9d9b76befbcba88845/roles/b488fca06c5144f48db762c7a2ab776b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:47.870386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0d9f-fccb-465e-add8-84ba6e77747e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:47.872067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f838-0a3f-4abc-9707-b5abc36beb7c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.872565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f838-0a3f-4abc-9707-b5abc36beb7c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.873043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1f838-0a3f-4abc-9707-b5abc36beb7c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.874979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 310/610] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:47.880822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b93ba-f81c-4cd0-97ee-08a8bb5a98c1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:47.881169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b93ba-f81c-4cd0-97ee-08a8bb5a98c1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:47.881376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b93ba-f81c-4cd0-97ee-08a8bb5a98c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:47.903775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-003b93ba-f81c-4cd0-97ee-08a8bb5a98c1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:47.905191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-003b93ba-f81c-4cd0-97ee-08a8bb5a98c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:47.913821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:48.048364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0d9f-fccb-465e-add8-84ba6e77747e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:48.078948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 311/611] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:48.095134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c348-6158-4c06-bf3c-2dd1335bd07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:48.097308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c348-6158-4c06-bf3c-2dd1335bd07e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:48.097308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c348-6158-4c06-bf3c-2dd1335bd07e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:48.097308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35c348-6158-4c06-bf3c-2dd1335bd07e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:48.111917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35c348-6158-4c06-bf3c-2dd1335bd07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-3d35c348-6158-4c06-bf3c-2dd1335bd07e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:48.117006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:48.120293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:48.123113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 301/612] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:48.134410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b93ba-f81c-4cd0-97ee-08a8bb5a98c1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:48.321375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b93ba-f81c-4cd0-97ee-08a8bb5a98c1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:48.387281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:48.388799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:48.389575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:48.390359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:48.391897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:48.392712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:48.395533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:48.414954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c348-6158-4c06-bf3c-2dd1335bd07e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:48.416387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 312/613] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:48.426675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:48.431876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:48.484135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:48.577319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35c348-6158-4c06-bf3c-2dd1335bd07e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:48.643509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d61a0-c040-47b3-8aab-e84bfc1d7192 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:48.648067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b31c5-523d-4a86-86f2-f094556236ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:48.648751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b31c5-523d-4a86-86f2-f094556236ea None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:48.649096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b31c5-523d-4a86-86f2-f094556236ea None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:48.649380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203b31c5-523d-4a86-86f2-f094556236ea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:48.661743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203b31c5-523d-4a86-86f2-f094556236ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-203b31c5-523d-4a86-86f2-f094556236ea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:48.668414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:48.670070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:48.671611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 302/614] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:48.683405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b31c5-523d-4a86-86f2-f094556236ea None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:48.704458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:48.705310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:48.705847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:48.706344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:48.736511 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:48.739147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:48.778187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:48.779284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:48.780268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:48.780268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:48.780268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:48.782706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 313/615] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:48.791286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:48.861264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203b31c5-523d-4a86-86f2-f094556236ea None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:48.863329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:48.884257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:48.934530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:48.936239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:48.937274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:48.938549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:48.940913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383b4f9-2acf-4b19-9141-7ae51e99464d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:48.941822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:48.942364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:48.945302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:48.964061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 303/616] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:48.970960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:48.989954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:48.990577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:48.990866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:48.991151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:48.991869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:48.992186 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:48.993584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:49.006876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 314/617] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:49.014866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:49.151851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d2c9-0fbe-454e-9ad0-e311f59298ed None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:49.180133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa7dda0-4be1-446b-9f6f-8e1fbe32a674 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:49.201493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:49.216149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:49.216793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:49.217081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:49.217364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:49.221595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:49.222268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:49.222559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:49.222841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:49.234527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:49.235338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:49.236820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:49.236939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:49.257115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:49.258148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:25:49.259147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:49.263680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:49.264543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:49.266573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:49.266573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:49.266573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:49.266742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 315/618] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:25:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:49.266811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 304/619] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:49.270942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:49.272396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:49.308132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:49.439247 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae4d6d-1a40-4249-aa7f-b413b2003a2f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:49.481003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a406880-85a0-4dc2-952a-95f90968c872 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:49.519155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:49.520149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:49.520629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:49.521447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:49.522800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:49.524265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:49.525862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:49.529009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:49.529843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:49.530356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:49.530836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:49.531804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:49.533314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:49.535060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:49.557024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 305/620] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:49.567405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 316/621] 10.222.0.88 () {56 vars in 1135 bytes} [Fri Aug 26 00:25:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:49.570270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:49.574927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:49.648372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:49.721797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:49.756106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1b3bf-df4e-4446-9afb-ff517ea638cb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:49.807251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be47dd1-564b-4f69-8259-aa9c5b110355 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:49.808717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:49.809638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:49.809945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:49.810227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:49.821624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:49.823474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:49.841598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:49.842640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:49.844432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 306/622] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:25:49.851495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:49.905139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:49.905794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:49.906111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:49.906479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:49.934721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:49.936204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:49.978940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:49.981355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:49.983515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:49.983515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:49.983515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:49.983515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 317/623] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:49.986648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:49.992980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5713136f-5dc9-4720-aaa5-3e8fb6bc1d06 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:50.032842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:50.033537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.033825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.034128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.034883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:50.035239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:50.036813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:50.060467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:50.077664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 307/624] 10.222.0.88 () {56 vars in 1137 bytes} [Fri Aug 26 00:25:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:50.084028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:50.139003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:50.168576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0823e80a-781c-44e8-b90e-0ea481488b36 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:50.215159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeffb4a-8311-4b5a-a86c-b38618c76b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:50.215675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeffb4a-8311-4b5a-a86c-b38618c76b55 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.215966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeffb4a-8311-4b5a-a86c-b38618c76b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.216242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeffb4a-8311-4b5a-a86c-b38618c76b55 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.216899 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeffb4a-8311-4b5a-a86c-b38618c76b55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:50.217231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeffb4a-8311-4b5a-a86c-b38618c76b55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:50.218619 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeffb4a-8311-4b5a-a86c-b38618c76b55 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:50.240170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 318/625] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:50.240170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58dd3-c38d-4250-86fb-a6475d7cf2e0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.240170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58dd3-c38d-4250-86fb-a6475d7cf2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.240170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f58dd3-c38d-4250-86fb-a6475d7cf2e0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.240695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 319/626] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:50.248256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58dd3-c38d-4250-86fb-a6475d7cf2e0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:50.271807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6ce88-7e0b-43eb-aacf-b261a85a61bd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:50.313376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d130aa7d-4214-4ec6-9f73-a679a51e9821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:50.314071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130aa7d-4214-4ec6-9f73-a679a51e9821 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.314353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130aa7d-4214-4ec6-9f73-a679a51e9821 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.314624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d130aa7d-4214-4ec6-9f73-a679a51e9821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.386344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:50.389056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f58dd3-c38d-4250-86fb-a6475d7cf2e0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:50.398011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130aa7d-4214-4ec6-9f73-a679a51e9821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:50.400125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d130aa7d-4214-4ec6-9f73-a679a51e9821 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:50.436293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe8fb8-bff3-43e8-80da-d08b54556d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:50.437186 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe8fb8-bff3-43e8-80da-d08b54556d4d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.437465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe8fb8-bff3-43e8-80da-d08b54556d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.438516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe8fb8-bff3-43e8-80da-d08b54556d4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.445723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe8fb8-bff3-43e8-80da-d08b54556d4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:50.447240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fe8fb8-bff3-43e8-80da-d08b54556d4d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-14fe8fb8-bff3-43e8-80da-d08b54556d4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:50.458933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:50.459872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:50.460849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 320/627] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:50.461338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2642f-9fa1-44a9-b128-607a5388522d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.462460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2642f-9fa1-44a9-b128-607a5388522d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.462460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2642f-9fa1-44a9-b128-607a5388522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.469374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:50.481036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9cf2642f-9fa1-44a9-b128-607a5388522d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:50.483024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9cf2642f-9fa1-44a9-b128-607a5388522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:50.542312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 308/628] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:25:50.543940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83872bd8-e48a-4ac4-9971-a6f3160c2598 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.544287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83872bd8-e48a-4ac4-9971-a6f3160c2598 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.544620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83872bd8-e48a-4ac4-9971-a6f3160c2598 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.546309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 309/629] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:50.547999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83872bd8-e48a-4ac4-9971-a6f3160c2598 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:50.575017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 321/630] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:50.575807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2642f-9fa1-44a9-b128-607a5388522d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:50.674606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:50.683147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83872bd8-e48a-4ac4-9971-a6f3160c2598 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:50.718160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2642f-9fa1-44a9-b128-607a5388522d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:50.722262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84a8f2-abf2-4ce4-a58b-b263008fb733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:50.723090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a8f2-abf2-4ce4-a58b-b263008fb733 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.723528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a8f2-abf2-4ce4-a58b-b263008fb733 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.723804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84a8f2-abf2-4ce4-a58b-b263008fb733 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.724502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84a8f2-abf2-4ce4-a58b-b263008fb733 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:50.724806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84a8f2-abf2-4ce4-a58b-b263008fb733 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:50.726286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84a8f2-abf2-4ce4-a58b-b263008fb733 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:50.739009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 310/631] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:50.744942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacdbf-56bc-4446-8501-33b6bdf20c9c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.745266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacdbf-56bc-4446-8501-33b6bdf20c9c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.745556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eacdbf-56bc-4446-8501-33b6bdf20c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.763607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f1c08-a889-4d64-bd17-6d9ee0e01b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:50.763948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f2eacdbf-56bc-4446-8501-33b6bdf20c9c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:50.764250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1c08-a889-4d64-bd17-6d9ee0e01b2c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.764529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1c08-a889-4d64-bd17-6d9ee0e01b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.764805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f1c08-a889-4d64-bd17-6d9ee0e01b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.765126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f2eacdbf-56bc-4446-8501-33b6bdf20c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:50.767014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:50.776724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f1c08-a889-4d64-bd17-6d9ee0e01b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:50.778303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f1c08-a889-4d64-bd17-6d9ee0e01b2c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-169f1c08-a889-4d64-bd17-6d9ee0e01b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:50.797983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:50.799800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:50.801507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:50.801507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:50.801507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:50.801507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 322/632] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:50.801507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda82607-f382-4d46-bd27-adec7cb5edb9 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.801507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda82607-f382-4d46-bd27-adec7cb5edb9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.801507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda82607-f382-4d46-bd27-adec7cb5edb9 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.802927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 323/633] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:50.803387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda82607-f382-4d46-bd27-adec7cb5edb9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:50.864663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 311/634] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:50.865443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eacdbf-56bc-4446-8501-33b6bdf20c9c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:50.943839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda82607-f382-4d46-bd27-adec7cb5edb9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:50.975529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:50.987453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8bfc9-b609-461e-a13d-4de2e96e99ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:50.988599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bfc9-b609-461e-a13d-4de2e96e99ad None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:50.988599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bfc9-b609-461e-a13d-4de2e96e99ad None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:50.989246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8bfc9-b609-461e-a13d-4de2e96e99ad None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/c266ac5c785d46488a1a1560283ba4fa/roles/b488fca06c5144f48db762c7a2ab776b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:50.997352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eacdbf-56bc-4446-8501-33b6bdf20c9c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.008646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8bfc9-b609-461e-a13d-4de2e96e99ad None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=c266ac5c785d46488a1a1560283ba4fa, role_id=b488fca06c5144f48db762c7a2ab776b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:51.010146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8bfc9-b609-461e-a13d-4de2e96e99ad None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:51.026065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 324/635] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:25:50 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/c266ac5c785d46488a1a1560283ba4fa/roles/b488fca06c5144f48db762c7a2ab776b => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:25:51.035445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea3a6-4551-4701-8707-2702c5e48c9d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.035705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea3a6-4551-4701-8707-2702c5e48c9d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.035983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ea3a6-4551-4701-8707-2702c5e48c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.047882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.048924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.049437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.049930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.050849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:51.051354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:51.053754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:51.060627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-271ea3a6-4551-4701-8707-2702c5e48c9d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:51.062324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-271ea3a6-4551-4701-8707-2702c5e48c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:51.075549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 312/636] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:51.077272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.102369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:51.161685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 325/637] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:51.163063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ea3a6-4551-4701-8707-2702c5e48c9d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.216104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e7ac4a-0060-4c6d-b192-4ca6cd12d7b1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.262880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd9c89-0f5d-4db9-a502-3d533c8792f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.265062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9c89-0f5d-4db9-a502-3d533c8792f9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.265189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9c89-0f5d-4db9-a502-3d533c8792f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.266157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cd9c89-0f5d-4db9-a502-3d533c8792f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.282563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cd9c89-0f5d-4db9-a502-3d533c8792f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-34cd9c89-0f5d-4db9-a502-3d533c8792f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:51.289917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:51.291625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 313/638] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:51.293101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd9c89-0f5d-4db9-a502-3d533c8792f9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.302876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:51.308142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ea3a6-4551-4701-8707-2702c5e48c9d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.350090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.351634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.352337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.353567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.364461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:51.366421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:51.380527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:51.381469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:51.382727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:51.382727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:51.382727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:51.382727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:51.382727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:51.382727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:51.382727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:51.382727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:51.384901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 326/639] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:51.386103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.417934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:51.454796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cd9c89-0f5d-4db9-a502-3d533c8792f9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.491207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529458-419c-4000-b674-abb129bda7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.491855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529458-419c-4000-b674-abb129bda7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.492144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529458-419c-4000-b674-abb129bda7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.492423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb529458-419c-4000-b674-abb129bda7a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.509423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d83bc2-1b26-41d2-8ccb-52980350f9bf None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.510146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb529458-419c-4000-b674-abb129bda7a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-fb529458-419c-4000-b674-abb129bda7a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:51.515946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:51.516868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:51.517698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 314/640] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:51.518394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529458-419c-4000-b674-abb129bda7a9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.557683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.558377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.558651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.558924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.559611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:51.559915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:51.561329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:51.576874 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 327/641] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:51.577759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.605689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:51.659139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb529458-419c-4000-b674-abb129bda7a9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.698478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.699011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.699293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.699568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.700275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:51.700581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:51.702052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:51.702595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:51.718369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00682be-b161-4ecf-bc82-7bc7211d572b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.724661 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 315/642] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:51.724661 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.762002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8402b0-7b96-406c-b0d2-c6f849c7e879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.762689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8402b0-7b96-406c-b0d2-c6f849c7e879 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.762979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8402b0-7b96-406c-b0d2-c6f849c7e879 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.763256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8402b0-7b96-406c-b0d2-c6f849c7e879 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.774856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8402b0-7b96-406c-b0d2-c6f849c7e879 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-3e8402b0-7b96-406c-b0d2-c6f849c7e879 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:51.780274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:51.782159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 328/643] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:51.783685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8402b0-7b96-406c-b0d2-c6f849c7e879 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.850397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4283d-d877-448a-bf50-dd32f745ad23 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.876833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:51.889699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.890483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.891517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.892100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.892880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:51.893302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:51.894882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:51.898467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8402b0-7b96-406c-b0d2-c6f849c7e879 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:51.908521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 316/644] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:51.908521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:51.940562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:51.941330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:51.941707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:51.942093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:51.953925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:51.955499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:51.964371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:51.972537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:51.973686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:51.974769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:51.974769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:51.974769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:51.977577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 329/645] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:51.978404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.036042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c55c0-d2ac-499d-b158-b8855539f36e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.071955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.072840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.073313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.073591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.074357 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=2be2cb98356b4d628408d094589a83e4) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:52.074669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.076133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.094399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 317/646] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/role_assignments?user.id=2be2cb98356b4d628408d094589a83e4&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:52.094399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.096657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4747f-b731-4b3a-9f3d-3a9534c621f8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.139394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.140121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.140488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.141352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.142139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:52.142518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.144034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.162053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 330/647] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:52.163000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.169658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:52.237052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:52.254934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521dc63-6464-4794-bef4-936d2f52781a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.291457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c386f515-b3ab-401a-a555-bfce8feba1ff None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.302009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.302965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.303810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.304800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.318195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.320291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.336552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:52.336739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:52.337597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:52.338502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:52.338502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:52.338502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:52.338679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.338679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.338679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.338861 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 318/648] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:52.338861 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.343326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:52.343326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.345110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.361407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 331/649] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:52.362154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.452290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3384e4c-d76c-4756-837e-7efb212d589b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.454724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:52.493744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.494809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.495268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.495741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.497470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1630b0-cd27-4829-a1de-37e54edf5026 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.508390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.510326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.525579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:52.528014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:52.529241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:52.530278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:52.530278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:52.530278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:52.538068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 319/650] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:52.539393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.541084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.541702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.542017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.542349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.543302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:52.543617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.545997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.566322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 332/651] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:52.568203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.681536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219d60c5-16e6-462e-af2c-b4751dfe7505 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.686896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a003ab-20cb-4e13-a396-caa9017e388f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.725720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.726366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.726649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.726924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.727341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.727569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:52.727876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.728437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.728863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.729249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.729450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.743021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.744651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.748006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 333/652] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:52.749000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:52.757494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:52.758736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:25:52.759918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:52.762439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 320/653] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:52.763198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.796009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:52.798294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:52.858003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243b0cd-c128-4bb1-a4cc-a6b2a7002aaf None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.895267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc1cfc-6a07-4873-bbaa-ab2077e44192 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:52.896791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.897746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.898124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.899362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.908400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.910262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:52.928248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:52.929498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:52.930565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 334/654] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:52.931157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:52.940188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:52.940909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:52.941255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:52.941596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:52.952636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:52.954233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:52.970994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:52.972319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 321/655] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:52.973249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:53.058341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003a109-8e8d-4ac3-941e-e1ee7621ca2e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:53.060048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:53.077420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:53.099558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:53.100171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.100454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.100791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.101519 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:53.101828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:53.103303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:53.107121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6896af06-4b2c-4ecc-bd41-ba74362fb28d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:53.126333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 335/656] 10.222.0.88 () {56 vars in 1137 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:53.126333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:53.148763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39506444-2fd1-43d6-9386-820d3ccd050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:53.149673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39506444-2fd1-43d6-9386-820d3ccd050a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.149995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39506444-2fd1-43d6-9386-820d3ccd050a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.150434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39506444-2fd1-43d6-9386-820d3ccd050a None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.151489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39506444-2fd1-43d6-9386-820d3ccd050a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:53.151931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39506444-2fd1-43d6-9386-820d3ccd050a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:53.153649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39506444-2fd1-43d6-9386-820d3ccd050a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:53.178034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 322/657] 10.222.0.88 () {56 vars in 1139 bytes} [Fri Aug 26 00:25:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:53.179738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ae18-fcb4-46ec-a790-05357063b0c8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.180734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ae18-fcb4-46ec-a790-05357063b0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.181040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7ae18-fcb4-46ec-a790-05357063b0c8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.182531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 323/658] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:53.183112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7ae18-fcb4-46ec-a790-05357063b0c8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:53.240683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa712f-f1de-4252-9d4a-ddc65309cbf2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:53.276461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:53.277075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.277363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.277635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.278411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:53.278719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:53.280159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:53.299965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 336/659] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:25:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:53.301982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7ae18-fcb4-46ec-a790-05357063b0c8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:53.305371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:53.325003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:53.339040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:53.346726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4837b5-9c2f-4510-a8fa-7b046d2421e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:53.347036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4837b5-9c2f-4510-a8fa-7b046d2421e7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.347276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4837b5-9c2f-4510-a8fa-7b046d2421e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.347549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4837b5-9c2f-4510-a8fa-7b046d2421e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.417275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26147d7f-7151-459b-bdf7-02f8015676ef None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:53.423190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4837b5-9c2f-4510-a8fa-7b046d2421e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:53.424647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4837b5-9c2f-4510-a8fa-7b046d2421e7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:53.456255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b44f3-0078-45ad-a9f3-232ea60683ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:53.457442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b44f3-0078-45ad-a9f3-232ea60683ac None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.458123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b44f3-0078-45ad-a9f3-232ea60683ac None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.458707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b44f3-0078-45ad-a9f3-232ea60683ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.537164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 324/660] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:53.538778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bbdbe-d584-4898-94c9-5911559b3a43 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.539241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bbdbe-d584-4898-94c9-5911559b3a43 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.539665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bbdbe-d584-4898-94c9-5911559b3a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.539778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b44f3-0078-45ad-a9f3-232ea60683ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:53.541154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b44f3-0078-45ad-a9f3-232ea60683ac None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:53.560592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:53.564594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f27bbdbe-d584-4898-94c9-5911559b3a43 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:53.565817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f27bbdbe-d584-4898-94c9-5911559b3a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:53.593269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:53.654199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 325/661] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:53.655209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bbdbe-d584-4898-94c9-5911559b3a43 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:53.661316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 337/662] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:53.661316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b44f3-0078-45ad-a9f3-232ea60683ac None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:53.780323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bbdbe-d584-4898-94c9-5911559b3a43 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:53.792803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b44f3-0078-45ad-a9f3-232ea60683ac None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:53.812090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:53.820530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca7d0e-fbb1-49c6-85a1-bc1690147c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:53.821382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7d0e-fbb1-49c6-85a1-bc1690147c23 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.821585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7d0e-fbb1-49c6-85a1-bc1690147c23 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.821962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcca7d0e-fbb1-49c6-85a1-bc1690147c23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.833242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:53.834126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:53.834548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:53.834965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:53.846284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:53.847992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:53.855898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:53.865150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:53.866346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:53.867317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:53.867317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:53.867317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:53.869090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 338/663] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:53.870115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:53.901157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca7d0e-fbb1-49c6-85a1-bc1690147c23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:53.902678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcca7d0e-fbb1-49c6-85a1-bc1690147c23 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:53.986172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a115fb-3df0-4ac7-b7c8-9d4e71d5b07d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.016895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 326/664] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:54.016895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca7d0e-fbb1-49c6-85a1-bc1690147c23 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.027006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.027745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.028024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.028308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.040283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.041752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:54.057021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:54.058505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:54.059370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:54.059370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:54.059370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:54.059370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 339/665] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:54.059604 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.090317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:54.092652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:54.139549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcca7d0e-fbb1-49c6-85a1-bc1690147c23 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.179497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962042d8-ea50-4ecb-8614-b922a06d72eb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.179741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.180341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.180628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.181021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.181589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:54.181936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.183333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.196054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 327/666] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:54.196891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.217006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beb11c-9bb3-460c-a549-387c18ce75e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.217638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beb11c-9bb3-460c-a549-387c18ce75e9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.217962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beb11c-9bb3-460c-a549-387c18ce75e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.218243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75beb11c-9bb3-460c-a549-387c18ce75e9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.229700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75beb11c-9bb3-460c-a549-387c18ce75e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-75beb11c-9bb3-460c-a549-387c18ce75e9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:54.235368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:54.236304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:54.237137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 340/667] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:54.237821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beb11c-9bb3-460c-a549-387c18ce75e9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.299738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cfc3b-022d-41d0-8b24-f6d2fb3c11fd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.320815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:54.323250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:54.337939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d65288-e0f5-48c4-978f-4546ed03119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.338566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d65288-e0f5-48c4-978f-4546ed03119f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.338844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d65288-e0f5-48c4-978f-4546ed03119f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.339115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d65288-e0f5-48c4-978f-4546ed03119f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.340133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75beb11c-9bb3-460c-a549-387c18ce75e9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.350326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d65288-e0f5-48c4-978f-4546ed03119f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.351730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d65288-e0f5-48c4-978f-4546ed03119f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c4d65288-e0f5-48c4-978f-4546ed03119f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:54.365863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:54.366843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:54.367705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:54.367705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:54.367705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:54.367705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 328/668] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:54.368166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5e2e-84a9-401a-8460-41e89781925a None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.368466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5e2e-84a9-401a-8460-41e89781925a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.368695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e5e2e-84a9-401a-8460-41e89781925a None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.370287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 329/669] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:54.370986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5e2e-84a9-401a-8460-41e89781925a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.380212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.380827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.381112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.381387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.382074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:54.382384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.383760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.396061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 341/670] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:54.396860 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.475883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e5e2e-84a9-401a-8460-41e89781925a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.499078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561b2dd-042d-462f-8764-64d18c9e3c92 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.509295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.509950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.510231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.510505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.516963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.518438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:54.530020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:54.531632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 330/671] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:54.532887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.537497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccadab-a6e1-4f22-b0d4-e4e010567b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.538141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccadab-a6e1-4f22-b0d4-e4e010567b46 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.538422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccadab-a6e1-4f22-b0d4-e4e010567b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.538693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccadab-a6e1-4f22-b0d4-e4e010567b46 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.539358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccadab-a6e1-4f22-b0d4-e4e010567b46 None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:54.539663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccadab-a6e1-4f22-b0d4-e4e010567b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.541050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccadab-a6e1-4f22-b0d4-e4e010567b46 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.551186 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 342/672] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:54.552559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c711e69-5c16-455f-9158-296233614bc6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.552796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c711e69-5c16-455f-9158-296233614bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.553071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c711e69-5c16-455f-9158-296233614bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.561870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:54.574085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4c711e69-5c16-455f-9158-296233614bc6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:54.575330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4c711e69-5c16-455f-9158-296233614bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:54.575894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:54.643517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 343/673] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:54.643703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7394a7a7-2e94-4729-b3e9-fdb4613b2a6f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.644280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c711e69-5c16-455f-9158-296233614bc6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.679855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.680446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.680728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.681182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.681631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:54.681960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.683321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.700340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 331/674] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:54.700340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.763678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c711e69-5c16-455f-9158-296233614bc6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.800013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.800925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.801046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:54.801520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.801520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.803367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:54.809447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4b1dad-9bfc-4cf8-a179-2c343e6f37b3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.809607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.811067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:54.823337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:54.824269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:54.825155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:54.825155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:54.825155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:54.825155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:54.825155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:54.825155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:54.825155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:54.825155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:54.829665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 344/675] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:54.830852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.859869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.860475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.860759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.861030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.861705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:54.862041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.863447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:54.875867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 332/676] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:54.876664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:54.943532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defa393b-d0b1-4f5a-824b-19474d97988a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.977245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:54.977896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:54.978202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:54.978409 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4df0b-766b-43ba-a026-3f61780d9044 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:54.978510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:54.989637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:54.991138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:55.006268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:55.007201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:55.008081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:55.008081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:55.008081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:55.008081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 345/677] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:55.008081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.022357 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.026391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.028255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.029758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.036748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.038340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:55.050280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:55.051166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:55.052057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 333/678] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:55.052581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.057705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:55.071069 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:55.121215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5fd294-2ae7-42da-b60b-f83c322edc90 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.155788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.156410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.156687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.156973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.157624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:55.157962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.159399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.160403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad519c-c0b9-49c0-8ec5-13911a5d0990 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.172552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 346/679] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:55.173344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.199737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.200289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.200572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.200844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.201565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=a0d14a63f09046efb6d5c2533f6d3609) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:55.201867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.203551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.209398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 334/680] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/role_assignments?user.id=a0d14a63f09046efb6d5c2533f6d3609&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:55.210204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.291624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0be11-05a6-4739-a233-2fea2f8377d7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.296730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:55.301688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:55.322526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336bf7d7-cff4-4733-975f-2f3d3fb18b0f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.338502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.339941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.340483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.340915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.356592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.357096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.363383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.363964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.364250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.364522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.365177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:55.365484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.366922 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:55.376558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:55.377509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:55.378706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:55.378706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:55.378706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:55.378706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 347/681] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:55.380242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.380787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 335/682] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:55.385354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.492505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed1452-e407-4bce-9bf6-e78583a7cffb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.502505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588d7944-e7b9-4487-ba2f-35717e01f9c0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.532415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.533023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.533306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.533585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.534350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=a0e9262597de4799a64977e44b41e6aa) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:55.534666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.536115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.539470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.540256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.540688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.541116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.542002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 336/683] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/role_assignments?user.id=a0e9262597de4799a64977e44b41e6aa&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:55.542598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:55.542797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.543214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.544672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.553088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:55.571257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 348/684] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:55.572382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.602259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:55.697196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006ba2c-bb4c-4791-a697-90bfbbb0ffef None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.699609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbab722-a5aa-4ac0-90cd-28477f6e1ffc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.737270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.738217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.738676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.739193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.740039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:55.740155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.740635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.740746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.741017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.741295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.742873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.749625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.751692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.761296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 337/685] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:55.761729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:25:55.768940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:55.769918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:55.770863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 349/686] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:55.771450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.850256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:55.873305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:55.887503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0463e-c277-419d-906b-a0a6eaad8b22 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.899097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36900f-b3bd-487f-839a-a768915f1ef0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:55.932490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.933458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.934019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.934515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.935450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=81ac50ea01de4a9d9b76befbcba88845) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:55.935992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.938192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.938956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5101a9-22c2-498b-9853-9f73a04667a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:55.939575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5101a9-22c2-498b-9853-9f73a04667a9 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:55.939861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5101a9-22c2-498b-9853-9f73a04667a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:55.940144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5101a9-22c2-498b-9853-9f73a04667a9 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:55.940866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5101a9-22c2-498b-9853-9f73a04667a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:55.942885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5101a9-22c2-498b-9853-9f73a04667a9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:55.946391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 338/687] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/role_assignments?user.id=81ac50ea01de4a9d9b76befbcba88845&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:55.947569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:55.981148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 350/688] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:25:55 2022] POST /identity/v3/users => generated 254 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:25:56.074525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88166b61-2f98-41df-a164-c48112f5bc2c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:56.106854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:56.117191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:56.118217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:56.118708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:56.119187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:56.120166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:56.120703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:56.122569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:56.146581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 339/689] 10.222.0.88 () {56 vars in 1135 bytes} [Fri Aug 26 00:25:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:56.154014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5101a9-22c2-498b-9853-9f73a04667a9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:56.297313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5101a9-22c2-498b-9853-9f73a04667a9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:56.334904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d088-44f9-43c0-837d-4470fa48455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:56.335451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d088-44f9-43c0-837d-4470fa48455c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:56.335736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d088-44f9-43c0-837d-4470fa48455c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:56.336013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725d088-44f9-43c0-837d-4470fa48455c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:56.338792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:56.419423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725d088-44f9-43c0-837d-4470fa48455c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:56.420913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725d088-44f9-43c0-837d-4470fa48455c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:56.529428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 351/690] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:25:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:25:56.536124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:56.696704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c45df-4f16-4dcf-942c-a47a360a47c0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:56.767119 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:56.768159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:56.768641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:56.769113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:56.783524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:56.786066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:56.802634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:56.803613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:56.805323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:56.805323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:56.805323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:56.805323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 340/691] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:56.809837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d088-44f9-43c0-837d-4470fa48455c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:56.855276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:56.955474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725d088-44f9-43c0-837d-4470fa48455c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:57.017110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:57.018149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:57.018627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:57.019085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:57.020202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:57.020727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:57.023190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:57.043343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 352/692] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:57.055206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:57.114794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:57.202488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85cb7-61b8-4cb1-8b07-d5d963275a04 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:57.251721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:57.252362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:57.252641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:57.252916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:57.259878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:57.261576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:25:57.273282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:57.275390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:57.277836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 341/693] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:57.285311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:57.396931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:57.406083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c4318-6e46-4e04-b117-d3df155f262b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:57.449503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f1046-66ba-4f40-83bf-b31c028ba127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:57.450148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1046-66ba-4f40-83bf-b31c028ba127 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:57.450437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1046-66ba-4f40-83bf-b31c028ba127 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:57.450717 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f1046-66ba-4f40-83bf-b31c028ba127 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:57.451419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f1046-66ba-4f40-83bf-b31c028ba127 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:57.451731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f1046-66ba-4f40-83bf-b31c028ba127 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:57.453237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f1046-66ba-4f40-83bf-b31c028ba127 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:57.470773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 353/694] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:25:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:57.476812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:57.531986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64605-400d-4f55-8334-00ca3d2f82bf None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:57.532303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64605-400d-4f55-8334-00ca3d2f82bf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:57.532475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce64605-400d-4f55-8334-00ca3d2f82bf None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:57.534199 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 354/695] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:25:57.539170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4779-9964-4623-871a-99c39b936d75 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:57.539465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4779-9964-4623-871a-99c39b936d75 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:57.539749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f4779-9964-4623-871a-99c39b936d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:57.576701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-655f4779-9964-4623-871a-99c39b936d75 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:57.578187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-655f4779-9964-4623-871a-99c39b936d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:57.601521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb69ac5-a964-430f-8d47-032c1d268b25 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:57.603169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:57.638735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fa1956-e7a9-4200-8373-db53998a77f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:57.639835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa1956-e7a9-4200-8373-db53998a77f0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:57.640196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa1956-e7a9-4200-8373-db53998a77f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:57.640583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fa1956-e7a9-4200-8373-db53998a77f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:57.641557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa1956-e7a9-4200-8373-db53998a77f0 None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=c266ac5c785d46488a1a1560283ba4fa) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:57.642123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa1956-e7a9-4200-8373-db53998a77f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:57.644043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fa1956-e7a9-4200-8373-db53998a77f0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:57.651066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 342/696] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:25:57 2022] GET /identity/v3/role_assignments?user.id=c266ac5c785d46488a1a1560283ba4fa&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:57.702080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 355/697] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:58.019249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854da3ba-7e3c-451e-a490-ae4c0569e9d6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.019628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854da3ba-7e3c-451e-a490-ae4c0569e9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.019843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854da3ba-7e3c-451e-a490-ae4c0569e9d6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.021420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 343/698] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:58.027579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c017-2958-4f4d-b9ad-929c0cb638a3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.028041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c017-2958-4f4d-b9ad-929c0cb638a3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.028136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16c017-2958-4f4d-b9ad-929c0cb638a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.048603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5f16c017-2958-4f4d-b9ad-929c0cb638a3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:58.049900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5f16c017-2958-4f4d-b9ad-929c0cb638a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:58.103626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854da3ba-7e3c-451e-a490-ae4c0569e9d6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:58.134055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 356/699] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:58.222578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854da3ba-7e3c-451e-a490-ae4c0569e9d6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:58.258770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861551bf-bb7b-4764-9005-81098ac7180a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:58.259409 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861551bf-bb7b-4764-9005-81098ac7180a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.259689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861551bf-bb7b-4764-9005-81098ac7180a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.259966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861551bf-bb7b-4764-9005-81098ac7180a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.260554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861551bf-bb7b-4764-9005-81098ac7180a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:58.261934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861551bf-bb7b-4764-9005-81098ac7180a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-861551bf-bb7b-4764-9005-81098ac7180a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:58.273417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:58.274475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:58.275979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 344/700] 10.222.0.88 () {56 vars in 1129 bytes} [Fri Aug 26 00:25:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:58.280615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16c017-2958-4f4d-b9ad-929c0cb638a3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:58.299891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:58.390899 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16c017-2958-4f4d-b9ad-929c0cb638a3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:58.394853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405719-4ff2-4363-9a0e-941654d7e986 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.395136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405719-4ff2-4363-9a0e-941654d7e986 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.395417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5405719-4ff2-4363-9a0e-941654d7e986 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.396757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 345/701] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:25:58.402356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7943c-06c5-4c5d-9897-393e3a7761ba None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.402642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7943c-06c5-4c5d-9897-393e3a7761ba None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.402926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7943c-06c5-4c5d-9897-393e3a7761ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.425126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bfa7943c-06c5-4c5d-9897-393e3a7761ba None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:58.426376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bfa7943c-06c5-4c5d-9897-393e3a7761ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:58.430957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:58.431578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.431955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.432302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.432948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:58.433255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:58.434685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:58.440580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 357/702] 10.222.0.88 () {56 vars in 1124 bytes} [Fri Aug 26 00:25:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:58.446667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:58.452625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:58.527361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 346/703] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:25:58.528237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7943c-06c5-4c5d-9897-393e3a7761ba None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:58.543649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:58.620053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbd66ad-f3b7-4093-9672-2604b138f564 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:58.650233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7943c-06c5-4c5d-9897-393e3a7761ba None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:58.691659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:58.692292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.692571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.692845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] PATH_INFO: `/v3/services/network` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.693433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:58.694953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:58.705095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:58.706123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:58.707910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 347/704] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:25:58 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:58.713656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681023e3-3b68-4277-80c7-e2b8c4795805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:58.714311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681023e3-3b68-4277-80c7-e2b8c4795805 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.714594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681023e3-3b68-4277-80c7-e2b8c4795805 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.714864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:58.715117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681023e3-3b68-4277-80c7-e2b8c4795805 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.715510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681023e3-3b68-4277-80c7-e2b8c4795805 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:58.715820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681023e3-3b68-4277-80c7-e2b8c4795805 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:58.717210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681023e3-3b68-4277-80c7-e2b8c4795805 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:58.725767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 358/705] 10.222.0.88 () {56 vars in 1124 bytes} [Fri Aug 26 00:25:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:58.762309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:58.876002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270d60-cfee-4d19-a91f-147a09369610 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.876366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270d60-cfee-4d19-a91f-147a09369610 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.876660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30270d60-cfee-4d19-a91f-147a09369610 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.878393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 359/706] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:25:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:25:58.881455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735140d-3c84-41dd-8f7c-903943e683f5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:58.884161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b8cc-a3ba-4bd9-8e32-74f8a513a256 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.884450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b8cc-a3ba-4bd9-8e32-74f8a513a256 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.884739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af62b8cc-a3ba-4bd9-8e32-74f8a513a256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.905616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-af62b8cc-a3ba-4bd9-8e32-74f8a513a256 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:25:58.906996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-af62b8cc-a3ba-4bd9-8e32-74f8a513a256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:25:58.921343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:58.922871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:58.923423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:58.923912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:58.924876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] RBAC: Adding query filter params (name=network) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:58.925430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:58.927043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:58.933142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 348/707] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:25:58 2022] GET /identity/v3/services?name=network => generated 124 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:58.934394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:58.990037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 360/708] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:25:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 26 00:25:58.991324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62b8cc-a3ba-4bd9-8e32-74f8a513a256 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:59.067690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:59.105240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc801848-8773-41c8-974e-83eafbb72433 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:59.136779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:59.154100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab16d8-7469-40f1-aa97-83b28d7d9aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:59.155115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab16d8-7469-40f1-aa97-83b28d7d9aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:59.155616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab16d8-7469-40f1-aa97-83b28d7d9aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:59.156716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab16d8-7469-40f1-aa97-83b28d7d9aa1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:59.170179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab16d8-7469-40f1-aa97-83b28d7d9aa1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-aaab16d8-7469-40f1-aa97-83b28d7d9aa1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:59.176629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:59.177596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:25:59.178458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:59.181663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 349/709] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:25:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:59.187281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab16d8-7469-40f1-aa97-83b28d7d9aa1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:59.201022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af62b8cc-a3ba-4bd9-8e32-74f8a513a256 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:59.291153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:59.291824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:59.292188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:59.292464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:59.293109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] RBAC: Adding query filter params (type=network) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:59.293412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:59.294825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:59.307914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 361/710] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:25:58 2022] GET /identity/v3/services?type=network => generated 124 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:59.308755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:59.322843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab16d8-7469-40f1-aa97-83b28d7d9aa1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:59.399552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:59.400091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:59.400375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:59.400652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:59.401348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:59.401649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:59.403095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:59.429570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 350/711] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:59.434212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:59.442276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:59.501812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ae412-e94b-4a37-a17c-175ce32a9375 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:59.542480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c2b29-da06-477f-ba84-454d5f26df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:59.543123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c2b29-da06-477f-ba84-454d5f26df9c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:59.543465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c2b29-da06-477f-ba84-454d5f26df9c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:59.543751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c2b29-da06-477f-ba84-454d5f26df9c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:59.548398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:59.567717 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c2b29-da06-477f-ba84-454d5f26df9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-868c2b29-da06-477f-ba84-454d5f26df9c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:25:59.573003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:59.573934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:25:59.574776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:25:59.578215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bcb76-a237-44fa-aae9-8bdaf9cafac9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:59.578354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 362/712] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:25:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:59.584750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c2b29-da06-477f-ba84-454d5f26df9c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:59.621440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:59.623037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:59.624025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:59.624309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:59.650220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:59.651594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:25:59.680977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:25:59.683238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:25:59.685300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:25:59.685300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:25:59.685300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:25:59.685300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 351/713] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:25:59.691563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:59.771760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c2b29-da06-477f-ba84-454d5f26df9c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:59.796423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:25:59.839431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:59.840114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:59.840404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:59.840679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:59.841348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:59.841656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:59.843076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:59.864554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 363/714] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:25:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:25:59.871404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:59.891191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ffece9-e3c7-4620-9bc7-3afe7045a761 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:25:59.946080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:25:59.946619 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:25:59.946966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:25:59.947242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:25:59.948517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:25:59.948826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:25:59.950499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:25:59.971436 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 352/715] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:25:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:25:59.977523 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:25:59.991602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:00.067921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8b0e9b-446f-4871-8bd2-d9b15386839c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:00.132116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:00.133244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.133726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.134230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.151788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:00.154692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:00.158219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d463531-64a9-43d4-9545-d70e2125c84b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:00.184901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:00.185957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:00.186838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:00.186838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:00.186838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:00.190619 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 364/716] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:25:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:00.199173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:00.203290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:00.228059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:00.228697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.228981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.229255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.241546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:00.243235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:00.258168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:00.259361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:00.260512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:00.267954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 353/717] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:25:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:00.274744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:00.381586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b449f3db-a6de-4d59-8505-28277b768af7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:00.400911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:00.430950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09a90f4-345d-4d08-bf14-9dcdab62dfa0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:00.441826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:00.442521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.442803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.443075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.443776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:00.444083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:00.446004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:00.470065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 365/718] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:00.474024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:00.505137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:00.505753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.506063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.506336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.507077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:00.507382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:00.511397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:00.541989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 354/719] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:26:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:00.544121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:00.598322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:00.636484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82658270-27ed-4fad-98b1-d6bed8e77347 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:00.677076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db9bb66-4107-44dc-bb03-faa1b3f1933e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:00.677833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9bb66-4107-44dc-bb03-faa1b3f1933e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.678213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9bb66-4107-44dc-bb03-faa1b3f1933e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.678555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db9bb66-4107-44dc-bb03-faa1b3f1933e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.687958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9bb66-4107-44dc-bb03-faa1b3f1933e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:00.690985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db9bb66-4107-44dc-bb03-faa1b3f1933e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:00.692266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f425492b-23ab-4e72-b724-b8530109af81 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-5db9bb66-4107-44dc-bb03-faa1b3f1933e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:00.705361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:00.706454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:00.707386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 366/720] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:26:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:00.708691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bedad5-0e25-426e-b8bc-4256bf0efe5a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.709039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bedad5-0e25-426e-b8bc-4256bf0efe5a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.709405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bedad5-0e25-426e-b8bc-4256bf0efe5a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.715093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 367/721] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:00.715093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bedad5-0e25-426e-b8bc-4256bf0efe5a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:00.739435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86e54-2d30-42fe-a97e-d126863a7994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:00.739988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86e54-2d30-42fe-a97e-d126863a7994 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.740314 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86e54-2d30-42fe-a97e-d126863a7994 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.740590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f86e54-2d30-42fe-a97e-d126863a7994 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.761753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:00.832910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f86e54-2d30-42fe-a97e-d126863a7994 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:00.834494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f86e54-2d30-42fe-a97e-d126863a7994 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:00.860065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bedad5-0e25-426e-b8bc-4256bf0efe5a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:00.878020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:00.902988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637b78a-6fcc-44af-a802-4518ce1678ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:00.903952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637b78a-6fcc-44af-a802-4518ce1678ad None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.904249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637b78a-6fcc-44af-a802-4518ce1678ad None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.904249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637b78a-6fcc-44af-a802-4518ce1678ad None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.905108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637b78a-6fcc-44af-a802-4518ce1678ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:00.905414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637b78a-6fcc-44af-a802-4518ce1678ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:00.907490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3637b78a-6fcc-44af-a802-4518ce1678ad None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:00.927850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 368/722] 10.222.0.88 () {56 vars in 1149 bytes} [Fri Aug 26 00:26:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:00.929463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8cc0-1e25-4c7f-bc10-6b222281811d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:00.929808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8cc0-1e25-4c7f-bc10-6b222281811d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:00.932630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef8cc0-1e25-4c7f-bc10-6b222281811d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:00.953101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b5ef8cc0-1e25-4c7f-bc10-6b222281811d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:00.954452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b5ef8cc0-1e25-4c7f-bc10-6b222281811d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:00.960073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 355/723] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 26 00:26:00.961210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86e54-2d30-42fe-a97e-d126863a7994 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.035779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 369/724] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:26:01.036614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef8cc0-1e25-4c7f-bc10-6b222281811d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.056198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:01.073140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f86e54-2d30-42fe-a97e-d126863a7994 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:01.110635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e1f2-d971-41ef-aa8c-2b2188f07094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:01.111607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e1f2-d971-41ef-aa8c-2b2188f07094 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.112139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e1f2-d971-41ef-aa8c-2b2188f07094 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.112616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e1f2-d971-41ef-aa8c-2b2188f07094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.122468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:01.157998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef8cc0-1e25-4c7f-bc10-6b222281811d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:01.193088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e1f2-d971-41ef-aa8c-2b2188f07094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:01.194589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7934e1f2-d971-41ef-aa8c-2b2188f07094 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:01.213632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7058ba3-da78-46bc-9104-549d3b93c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:01.214782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7058ba3-da78-46bc-9104-549d3b93c428 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.215144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7058ba3-da78-46bc-9104-549d3b93c428 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.215497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7058ba3-da78-46bc-9104-549d3b93c428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.230225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7058ba3-da78-46bc-9104-549d3b93c428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:01.232531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7058ba3-da78-46bc-9104-549d3b93c428 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-b7058ba3-da78-46bc-9104-549d3b93c428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:01.254292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:01.255283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:01.259761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:01.259761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:01.259761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:01.259761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 370/725] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:01.259761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022992-e4b0-4b7f-aa3e-637b0baee837 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.259761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022992-e4b0-4b7f-aa3e-637b0baee837 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.259761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5022992-e4b0-4b7f-aa3e-637b0baee837 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.259761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 371/726] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:01.264029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022992-e4b0-4b7f-aa3e-637b0baee837 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.315335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 356/727] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 26 00:26:01.317120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c843c-01de-4a0c-a1d1-56b4c6e390e0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.317401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c843c-01de-4a0c-a1d1-56b4c6e390e0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.317910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2c843c-01de-4a0c-a1d1-56b4c6e390e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.337044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6e2c843c-01de-4a0c-a1d1-56b4c6e390e0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:01.338615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6e2c843c-01de-4a0c-a1d1-56b4c6e390e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:01.354277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:01.370915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:01.391608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5022992-e4b0-4b7f-aa3e-637b0baee837 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:01.419344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 357/728] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:26:01.420456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c843c-01de-4a0c-a1d1-56b4c6e390e0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.442912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:01.444466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.445215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.445689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.446877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:01.447911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:01.450175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:01.472253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 372/729] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:01.472253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.537073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2c843c-01de-4a0c-a1d1-56b4c6e390e0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:01.573996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44095cac-4f2b-49e2-a9af-a608dd3bde5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:01.574993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095cac-4f2b-49e2-a9af-a608dd3bde5d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.575513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095cac-4f2b-49e2-a9af-a608dd3bde5d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.576558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44095cac-4f2b-49e2-a9af-a608dd3bde5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.586782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9683054-7e2d-48e1-a595-3bd72a24729f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:01.588706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44095cac-4f2b-49e2-a9af-a608dd3bde5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-44095cac-4f2b-49e2-a9af-a608dd3bde5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:01.595266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:01.596198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:01.597028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:01.598483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 358/730] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:01.599095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44095cac-4f2b-49e2-a9af-a608dd3bde5d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.624168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:01.631547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad7c0ab-77f4-4550-919d-f98f1d8a2e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:01.632207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c0ab-77f4-4550-919d-f98f1d8a2e60 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.632486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c0ab-77f4-4550-919d-f98f1d8a2e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.632755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7c0ab-77f4-4550-919d-f98f1d8a2e60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.635090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:01.644023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7c0ab-77f4-4550-919d-f98f1d8a2e60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:01.645486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad7c0ab-77f4-4550-919d-f98f1d8a2e60 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-1ad7c0ab-77f4-4550-919d-f98f1d8a2e60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:01.661461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:01.662481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:01.663347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:01.663347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:01.663347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:01.663347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 373/731] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:01.664798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cca5-e726-40d7-9c70-b63ff1cf1712 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.665140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cca5-e726-40d7-9c70-b63ff1cf1712 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.665415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678cca5-e726-40d7-9c70-b63ff1cf1712 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.669948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 374/732] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:01.669948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cca5-e726-40d7-9c70-b63ff1cf1712 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.732966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44095cac-4f2b-49e2-a9af-a608dd3bde5d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:01.770965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:01.771593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.771880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.772153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.778979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:01.780439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:01.786080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678cca5-e726-40d7-9c70-b63ff1cf1712 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:01.793843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:01.794770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 359/733] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:01.795717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.833150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20fdb0f-78c0-458e-ad92-16b5ae372641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:01.833954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fdb0f-78c0-458e-ad92-16b5ae372641 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.834360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fdb0f-78c0-458e-ad92-16b5ae372641 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.834728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20fdb0f-78c0-458e-ad92-16b5ae372641 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.835681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fdb0f-78c0-458e-ad92-16b5ae372641 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:01.836105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fdb0f-78c0-458e-ad92-16b5ae372641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:01.838063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20fdb0f-78c0-458e-ad92-16b5ae372641 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:01.850630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 375/734] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:01.852054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1784e-f029-40b6-a178-5eccd8f2de8d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.852517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1784e-f029-40b6-a178-5eccd8f2de8d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.852855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1784e-f029-40b6-a178-5eccd8f2de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.875949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ace1784e-f029-40b6-a178-5eccd8f2de8d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:01.877579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ace1784e-f029-40b6-a178-5eccd8f2de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:01.882363 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:01.899784 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656fab14-0ddb-4069-bc62-38d0a5157b58 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:01.931005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:01.939175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:01.939787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:01.940071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:01.940351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:01.940996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:01.941427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:01.944170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:01.958245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 360/735] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:01.959075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:01.965970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 376/736] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 26 00:26:01.965970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1784e-f029-40b6-a178-5eccd8f2de8d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.074558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1784e-f029-40b6-a178-5eccd8f2de8d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.077443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055aaa6-cb29-4c57-a252-aebf55541768 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.117228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82cb49-bc0b-4e78-a7fc-6d9f766c0bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.118649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82cb49-bc0b-4e78-a7fc-6d9f766c0bd1 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.119399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82cb49-bc0b-4e78-a7fc-6d9f766c0bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.119882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82cb49-bc0b-4e78-a7fc-6d9f766c0bd1 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.120738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82cb49-bc0b-4e78-a7fc-6d9f766c0bd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:02.122345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82cb49-bc0b-4e78-a7fc-6d9f766c0bd1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:02.124184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.125160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.125630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.125948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.126919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:02.127239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:02.128689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:02.147210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 377/737] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:02.147210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.154135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 361/738] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:26:01 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:02.156273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82cb49-bc0b-4e78-a7fc-6d9f766c0bd1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.163235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:02.195710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:02.279072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654d505-4a66-4503-a44c-e719aa1c41d7 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.321609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82cb49-bc0b-4e78-a7fc-6d9f766c0bd1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.324768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.326562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.326562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.326562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.341780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:02.344242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:02.360201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:02.361250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:02.362183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:02.362183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:02.362183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:02.362183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 378/739] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:02.362415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.372480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.373305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.373305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.373580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.382238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:02.383841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:02.397490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:02.398719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:02.399605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 362/740] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:02.400086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.465285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:02.472178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:02.481671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5ea49-dc1d-43a9-a162-20c9a76d864a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.518940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.519770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5474d-2220-4528-bc7f-d8575f9d545a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.520148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.520629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.521104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.522156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=81ac50ea01de4a9d9b76befbcba88845) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:02.522473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:02.524003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:02.529842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 379/741] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:02 2022] GET /identity/v3/role_assignments?user.id=81ac50ea01de4a9d9b76befbcba88845&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=f21c9b5697b747d39bf8f104797da245 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:02.530790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.593675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be283f26-28fb-4609-95eb-20aaad5b8bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.595271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283f26-28fb-4609-95eb-20aaad5b8bc2 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.595746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283f26-28fb-4609-95eb-20aaad5b8bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.596650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be283f26-28fb-4609-95eb-20aaad5b8bc2 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.597858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be283f26-28fb-4609-95eb-20aaad5b8bc2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:02.600468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be283f26-28fb-4609-95eb-20aaad5b8bc2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:02.622997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 363/742] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:26:02 2022] POST /identity/v3/services => generated 240 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:02.624262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be283f26-28fb-4609-95eb-20aaad5b8bc2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.699742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ff01f-fae8-4ef5-82a0-fd2b2834f993 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.755834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.756463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.756749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.757022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.758512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:02.758831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:02.760454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:02.789228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 380/743] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:02.802149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.815768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:02.819610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be283f26-28fb-4609-95eb-20aaad5b8bc2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.849580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:02.868883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.869826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.870398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.870682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.871445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:02.871886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:02.874069 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:02.892694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 364/744] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:02.899232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:02.933811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13296522-0a62-44d0-832e-4df8b70965f1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:02.987760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:02.988694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:02.989428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:02.989428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:02.999112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:03.001417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:03.018705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:03.019729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:03.020997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 381/745] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:03.031309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:03.037333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efbfb86-3d79-41b2-bd98-367243e0e6e0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:03.110973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:03.113708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:03.114173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:03.114624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:03.115517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=902b00eca0fa4008b98205dfc26f4a6e) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:03.115979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:03.119178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:03.138500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 365/746] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:02 2022] GET /identity/v3/role_assignments?user.id=902b00eca0fa4008b98205dfc26f4a6e&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:03.162286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:03.200586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab83ec-25fb-4cd2-98bd-abbbbbe363eb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:03.253235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:03.253858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:03.254169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:03.254452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:03.255187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:03.255506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:03.256943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:03.281732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 382/747] 10.222.0.88 () {56 vars in 1135 bytes} [Fri Aug 26 00:26:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:03.288806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:03.356543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:03.421716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4745eba-e407-4dbb-8013-9d49b86bf877 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:03.467304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01df812-2a37-449c-b2fa-5cb59cd3ff8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:03.467929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01df812-2a37-449c-b2fa-5cb59cd3ff8f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:03.468742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01df812-2a37-449c-b2fa-5cb59cd3ff8f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:03.469020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01df812-2a37-449c-b2fa-5cb59cd3ff8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:03.550042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01df812-2a37-449c-b2fa-5cb59cd3ff8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:03.551871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01df812-2a37-449c-b2fa-5cb59cd3ff8f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:03.605711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:03.668699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 366/748] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:03 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:26:03.677724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:03.812968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adbbbbb-5420-4d5d-ae54-dc200125c4d6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:03.839301 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:03.850928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:03.851802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:03.852088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:03.852363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:03.863988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:03.865473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:03.882069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:03.883064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:03.883947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:03.883947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:03.883947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:03.883947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 383/749] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:03.890577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01df812-2a37-449c-b2fa-5cb59cd3ff8f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:04.051631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01df812-2a37-449c-b2fa-5cb59cd3ff8f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:04.100935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b71316-d315-45af-9a55-793770594d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:04.101565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71316-d315-45af-9a55-793770594d7c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:04.101853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71316-d315-45af-9a55-793770594d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:04.102151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b71316-d315-45af-9a55-793770594d7c None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:04.102810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b71316-d315-45af-9a55-793770594d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:04.103118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b71316-d315-45af-9a55-793770594d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:04.104615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b71316-d315-45af-9a55-793770594d7c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:04.123628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 367/750] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:04.129591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:04.280921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84ec67-cd65-48b5-9f73-33adc72f8405 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:04.329629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa79c78-fa7f-46c3-a38d-35c7b13932eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:04.330614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa79c78-fa7f-46c3-a38d-35c7b13932eb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:04.331112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa79c78-fa7f-46c3-a38d-35c7b13932eb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:04.331584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa79c78-fa7f-46c3-a38d-35c7b13932eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:04.349822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa79c78-fa7f-46c3-a38d-35c7b13932eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:04.351762 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa79c78-fa7f-46c3-a38d-35c7b13932eb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-faa79c78-fa7f-46c3-a38d-35c7b13932eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:04.368772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:04.369731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:04.370636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:04.370636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:04.370636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:04.370636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:04.370636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:04.370636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:04.370636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:04.370636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:04.372724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 384/751] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:04.378711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b71316-d315-45af-9a55-793770594d7c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:04.387056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:04.457970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2409e-c637-4cf1-9667-14feb0ac3e06 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:04.458630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2409e-c637-4cf1-9667-14feb0ac3e06 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:04.459112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e2409e-c637-4cf1-9667-14feb0ac3e06 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:04.460905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 385/752] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:04.466709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926093fd-01fb-4a54-a8ed-703a1170f42d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:04.467309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926093fd-01fb-4a54-a8ed-703a1170f42d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:04.467812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926093fd-01fb-4a54-a8ed-703a1170f42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:04.499178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-926093fd-01fb-4a54-a8ed-703a1170f42d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:04.501833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-926093fd-01fb-4a54-a8ed-703a1170f42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:04.562278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:04.562540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b71316-d315-45af-9a55-793770594d7c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:04.599835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96fcd0b-2039-43b5-8942-2f0620a238a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:04.600372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fcd0b-2039-43b5-8942-2f0620a238a7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:04.600658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fcd0b-2039-43b5-8942-2f0620a238a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:04.600935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96fcd0b-2039-43b5-8942-2f0620a238a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:04.601632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fcd0b-2039-43b5-8942-2f0620a238a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:04.601968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fcd0b-2039-43b5-8942-2f0620a238a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:04.603414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96fcd0b-2039-43b5-8942-2f0620a238a7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:04.680580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 386/753] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:04.736748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 368/754] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:04.742683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926093fd-01fb-4a54-a8ed-703a1170f42d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:04.871943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926093fd-01fb-4a54-a8ed-703a1170f42d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:04.920011 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90959d49-08d9-4ba4-a674-ef15f81ecca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:04.920698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90959d49-08d9-4ba4-a674-ef15f81ecca4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:04.920992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90959d49-08d9-4ba4-a674-ef15f81ecca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:04.921841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90959d49-08d9-4ba4-a674-ef15f81ecca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:04.923010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90959d49-08d9-4ba4-a674-ef15f81ecca4 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=c266ac5c785d46488a1a1560283ba4fa) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:04.923329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90959d49-08d9-4ba4-a674-ef15f81ecca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:04.924855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90959d49-08d9-4ba4-a674-ef15f81ecca4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:04.931578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 387/755] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:04 2022] GET /identity/v3/role_assignments?user.id=c266ac5c785d46488a1a1560283ba4fa&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=f21c9b5697b747d39bf8f104797da245 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:04.995485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910da92-05ab-40c7-a841-c80f4eb6af16 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:04.995811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910da92-05ab-40c7-a841-c80f4eb6af16 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:04.996035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910da92-05ab-40c7-a841-c80f4eb6af16 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:04.997375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 369/756] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:05.003648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8ba0-e5b6-4c5a-939c-f50a704a9e04 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.003956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8ba0-e5b6-4c5a-939c-f50a704a9e04 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.004221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc8ba0-e5b6-4c5a-939c-f50a704a9e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.025379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910da92-05ab-40c7-a841-c80f4eb6af16 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:05.027020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-02fc8ba0-e5b6-4c5a-939c-f50a704a9e04 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:05.028558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-02fc8ba0-e5b6-4c5a-939c-f50a704a9e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:05.082151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:05.154985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 388/757] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:05.163520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:05.221471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910da92-05ab-40c7-a841-c80f4eb6af16 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:05.266223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:05.266866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.267146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.267416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.268000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:05.269371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:05.283134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:05.284139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:05.284959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 370/758] 10.222.0.88 () {56 vars in 1129 bytes} [Fri Aug 26 00:26:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:05.290507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8ba0-e5b6-4c5a-939c-f50a704a9e04 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:05.433382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc8ba0-e5b6-4c5a-939c-f50a704a9e04 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:05.470539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:05.471160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.471448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.471726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.472364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:05.472677 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:05.474113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:05.479212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 389/759] 10.222.0.88 () {56 vars in 1124 bytes} [Fri Aug 26 00:26:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:05.488391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:05.509093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:05.566759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:05.645905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef164f-7ecc-4cd4-9f62-c0a6483c9021 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:05.672723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd9e41-fbe3-43b4-b339-faa2d455f6e0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:05.680175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:05.692246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d408f75-81da-4562-bd54-426a04a14b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:05.693058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d408f75-81da-4562-bd54-426a04a14b6c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.693746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d408f75-81da-4562-bd54-426a04a14b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.694160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d408f75-81da-4562-bd54-426a04a14b6c None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.694964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d408f75-81da-4562-bd54-426a04a14b6c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:05.695375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d408f75-81da-4562-bd54-426a04a14b6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:05.697367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d408f75-81da-4562-bd54-426a04a14b6c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:05.706347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 371/760] 10.222.0.88 () {56 vars in 1124 bytes} [Fri Aug 26 00:26:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:05.707765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a17f0-5df3-4304-a691-30103706eae5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.708155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a17f0-5df3-4304-a691-30103706eae5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.708532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a17f0-5df3-4304-a691-30103706eae5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.710103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 372/761] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:05.713676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a17f0-5df3-4304-a691-30103706eae5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:05.724331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4ac5d-40e7-4b19-ad5a-68da0933f48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:05.724331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ac5d-40e7-4b19-ad5a-68da0933f48c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.724331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ac5d-40e7-4b19-ad5a-68da0933f48c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.725136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4ac5d-40e7-4b19-ad5a-68da0933f48c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.750132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4ac5d-40e7-4b19-ad5a-68da0933f48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9bc4ac5d-40e7-4b19-ad5a-68da0933f48c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:05.756633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:05.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:05.758571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:05.761343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 390/762] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:05.762866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f3ba-b6bd-4f45-b9e5-f94ec138616f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.763318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f3ba-b6bd-4f45-b9e5-f94ec138616f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.763851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f3ba-b6bd-4f45-b9e5-f94ec138616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.783680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-95c1f3ba-b6bd-4f45-b9e5-f94ec138616f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:05.785309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-95c1f3ba-b6bd-4f45-b9e5-f94ec138616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:05.841010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a17f0-5df3-4304-a691-30103706eae5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:05.861664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 391/763] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:05.862990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1f3ba-b6bd-4f45-b9e5-f94ec138616f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:05.884994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:05.888076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a42aa-abf7-4f99-83f5-3a4fd24cfb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:05.888982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a42aa-abf7-4f99-83f5-3a4fd24cfb8c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.889509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a42aa-abf7-4f99-83f5-3a4fd24cfb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.890761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a42aa-abf7-4f99-83f5-3a4fd24cfb8c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.891688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a42aa-abf7-4f99-83f5-3a4fd24cfb8c None admin] RBAC: Adding query filter params (interface=public, service_id=d247e875feb94897ac3a49b15968dcd3, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:05.892244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a42aa-abf7-4f99-83f5-3a4fd24cfb8c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:05.893820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a42aa-abf7-4f99-83f5-3a4fd24cfb8c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:05.902413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 373/764] 10.222.0.88 () {56 vars in 1251 bytes} [Fri Aug 26 00:26:05 2022] GET /identity/v3/endpoints?service_id=d247e875feb94897ac3a49b15968dcd3&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:05.903923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5f0a8-bae8-4cee-b7c2-538e48129e29 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:05.904448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5f0a8-bae8-4cee-b7c2-538e48129e29 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:05.904926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e5f0a8-bae8-4cee-b7c2-538e48129e29 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:05.906715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 374/765] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:05.908324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5f0a8-bae8-4cee-b7c2-538e48129e29 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:05.986431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:05.995976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1f3ba-b6bd-4f45-b9e5-f94ec138616f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.041913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e5f0a8-bae8-4cee-b7c2-538e48129e29 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.043466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f6efa-f70e-44a6-a40c-af16f8151a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.044350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f6efa-f70e-44a6-a40c-af16f8151a9e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.044644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f6efa-f70e-44a6-a40c-af16f8151a9e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.044929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f6efa-f70e-44a6-a40c-af16f8151a9e None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.046113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f6efa-f70e-44a6-a40c-af16f8151a9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:06.047316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f6efa-f70e-44a6-a40c-af16f8151a9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:06.048866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f6efa-f70e-44a6-a40c-af16f8151a9e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:06.063448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 392/766] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:06.064828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc146f-3330-4192-8ac1-d2729ac4221a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.065122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc146f-3330-4192-8ac1-d2729ac4221a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.065400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc146f-3330-4192-8ac1-d2729ac4221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.084729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-70cc146f-3330-4192-8ac1-d2729ac4221a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:06.086043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-70cc146f-3330-4192-8ac1-d2729ac4221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:06.092136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd00f74-5999-46b8-9e1a-01e06507e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.092981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd00f74-5999-46b8-9e1a-01e06507e468 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.094186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd00f74-5999-46b8-9e1a-01e06507e468 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.094755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd00f74-5999-46b8-9e1a-01e06507e468 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.095525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd00f74-5999-46b8-9e1a-01e06507e468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:06.097643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd00f74-5999-46b8-9e1a-01e06507e468 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:06.105395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 375/767] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:26:05 2022] GET /identity/v3/services => generated 772 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:06.106679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd00f74-5999-46b8-9e1a-01e06507e468 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:06.168135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 393/768] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:06.197914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc146f-3330-4192-8ac1-d2729ac4221a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:06.208161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:06.299069 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd00f74-5999-46b8-9e1a-01e06507e468 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.324663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:06.343183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.344218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.344735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.345188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.359522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:06.361085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:06.376165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc146f-3330-4192-8ac1-d2729ac4221a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:06.378052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:06.378970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:06.379848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:06.379848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:06.379848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:06.379848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 376/769] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:06.387045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:06.438658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.439367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.439658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.440872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] PATH_INFO: `/v3/services/network` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.441484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:06.442979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:06.454992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:06.456015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:26:06.456885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:06.457722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 394/770] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:06.464223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:06.557123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4153515a-2ae6-492c-a16b-30c66ebfe05d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.580094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:06.598654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.599470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.599865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.600242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.600999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:06.601427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:06.603246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:06.617653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 377/771] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:06.618733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:06.620447 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6eac8-d02b-4056-95aa-9d30b35d46ba None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.652266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:06.662802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.664210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.664879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.665517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.666554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] RBAC: Adding query filter params (name=network) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:06.667033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:06.668884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:06.675896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 395/772] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:06.677090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:06.737343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baacf78-b487-4aa5-9d3a-e0ff77ac7ac4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.776891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96bd43-7e60-44fd-bb2a-982755415e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.777538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96bd43-7e60-44fd-bb2a-982755415e7f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.777823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96bd43-7e60-44fd-bb2a-982755415e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.778179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c96bd43-7e60-44fd-bb2a-982755415e7f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.790660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c96bd43-7e60-44fd-bb2a-982755415e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-3c96bd43-7e60-44fd-bb2a-982755415e7f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:06.797546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:06.798679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:06.799526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 378/773] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:06.800238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96bd43-7e60-44fd-bb2a-982755415e7f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:06.808758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77eec600-f5e0-448a-b33a-bdce02eaeaf1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.849657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.850714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.851209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.851693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.854273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:06.862490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:06.864363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:06.878661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:06.879663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:06.880579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:06.883228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 396/774] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:06.884238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:06.906382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:06.916705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c96bd43-7e60-44fd-bb2a-982755415e7f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:06.963917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:06.964979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:06.965481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:06.966034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:06.966893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] RBAC: Adding query filter params (type=network) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:06.967254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:06.969517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:06.980230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 379/775] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:06.981356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.004392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e681ce68-57cd-4903-8578-10b07624eeeb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:07.045324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:07.047328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.047883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.048487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.049468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:07.050004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:07.051727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:07.066387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 397/776] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:07.067761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.095078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc5d2b-db06-4a39-8232-c54e1d08da83 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:07.131936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:07.135298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:07.136360 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.136799 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.137086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.137983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:07.138452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:07.140532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:07.167881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 380/777] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:26:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:07.167881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.183725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec523c-4a5d-40dc-b286-7608428115ec None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:07.193301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:07.234455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d931ef1f-654f-43b2-9ed3-e3e9486242c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:07.235139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931ef1f-654f-43b2-9ed3-e3e9486242c5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.235420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931ef1f-654f-43b2-9ed3-e3e9486242c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.235684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d931ef1f-654f-43b2-9ed3-e3e9486242c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.236484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931ef1f-654f-43b2-9ed3-e3e9486242c5 None admin] RBAC: Adding query filter params (interface=public, service_id=a42845cf90fb454882057239505ef2e6, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:07.236791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931ef1f-654f-43b2-9ed3-e3e9486242c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:07.238226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d931ef1f-654f-43b2-9ed3-e3e9486242c5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:07.250029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 398/778] 10.222.0.88 () {56 vars in 1251 bytes} [Fri Aug 26 00:26:07 2022] GET /identity/v3/endpoints?service_id=a42845cf90fb454882057239505ef2e6&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:07.251541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abefe7-de9c-4240-872c-3d25fa7b14f1 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.251829 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abefe7-de9c-4240-872c-3d25fa7b14f1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.252272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4abefe7-de9c-4240-872c-3d25fa7b14f1 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.257926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 399/779] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:07.257926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abefe7-de9c-4240-872c-3d25fa7b14f1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.287383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368cbd4-6145-4cc8-b855-8b8cfb631a8a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:07.324687 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:07.325227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.325511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.325788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.336717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:07.338214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:07.355502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:07.356494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:07.357435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:07.357435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:07.357435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:07.357616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 381/780] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:07.358333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.376775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4abefe7-de9c-4240-872c-3d25fa7b14f1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:07.398448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:07.415548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c9903-3df5-46ff-ace6-9152db6e4346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:07.416749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9903-3df5-46ff-ace6-9152db6e4346 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.417039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9903-3df5-46ff-ace6-9152db6e4346 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.417474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c9903-3df5-46ff-ace6-9152db6e4346 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.430258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:07.437997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c9903-3df5-46ff-ace6-9152db6e4346 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:07.439546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c9903-3df5-46ff-ace6-9152db6e4346 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-768c9903-3df5-46ff-ace6-9152db6e4346 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:07.456672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:07.457694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:07.458593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:07.458593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:07.458593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:07.458593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 400/781] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:07.459448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea6d6-1e05-4f8d-9769-434b35da3c30 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.459448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea6d6-1e05-4f8d-9769-434b35da3c30 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.459574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebea6d6-1e05-4f8d-9769-434b35da3c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.474650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d9b18c-75ca-42d9-bef4-0f81314a0d89 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:07.478830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-eebea6d6-1e05-4f8d-9769-434b35da3c30 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:07.480021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eebea6d6-1e05-4f8d-9769-434b35da3c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:07.512456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a63fb-6a91-4db6-9fcb-60d69dab447e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:07.513063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a63fb-6a91-4db6-9fcb-60d69dab447e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.513376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a63fb-6a91-4db6-9fcb-60d69dab447e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.513609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a63fb-6a91-4db6-9fcb-60d69dab447e None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.514297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a63fb-6a91-4db6-9fcb-60d69dab447e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:07.515858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a63fb-6a91-4db6-9fcb-60d69dab447e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:07.529920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 382/782] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:26:07 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:07.529920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a63fb-6a91-4db6-9fcb-60d69dab447e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.573490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 401/783] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:07.574599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebea6d6-1e05-4f8d-9769-434b35da3c30 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.712350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a63fb-6a91-4db6-9fcb-60d69dab447e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:07.763709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:07.764030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebea6d6-1e05-4f8d-9769-434b35da3c30 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:07.767271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:07.781329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:07.782020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.782304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.782577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.783229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:07.783532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:07.784925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:07.802248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 383/784] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:07.808072 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.819499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:07.820471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:07.820973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:07.821508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:07.822414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:07.822972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:07.824605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:07.839208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 402/785] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:07.847154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:07.981436 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9f74a-1f81-4790-926d-3d7c2c0f1507 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.021496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbabc335-64c3-46bb-ae99-2fa4364aa56f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.029227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.030243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.035482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.035883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.056856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:08.060690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:08.086697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:08.087726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:08.088629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 384/786] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:26:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:08.089855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:08.103666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.104420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.104706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.104977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.113224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:08.114893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:08.128169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:08.129111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:08.130004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:08.130004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:08.130004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:08.130004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:08.130004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:08.130004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:08.130004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:08.130004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:08.134894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 403/787] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:08.135815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:08.149027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:08.166122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:08.228214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5299db1c-f645-4c13-a69b-23f796cb568d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.266014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631068a-a4fa-4b10-bfa1-4bef17aa10be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.266912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631068a-a4fa-4b10-bfa1-4bef17aa10be None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.267359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631068a-a4fa-4b10-bfa1-4bef17aa10be None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.267771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631068a-a4fa-4b10-bfa1-4bef17aa10be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.267902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e13cb54-8e6a-4db2-b27a-44ac3fa077c6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.280062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631068a-a4fa-4b10-bfa1-4bef17aa10be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b631068a-a4fa-4b10-bfa1-4bef17aa10be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:08.286697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:08.293138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:08.293995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:08.296337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 385/788] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:08.297481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631068a-a4fa-4b10-bfa1-4bef17aa10be None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:08.317008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5d3a0-64fa-4c20-a351-4855bdabb258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.317629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5d3a0-64fa-4c20-a351-4855bdabb258 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.317952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5d3a0-64fa-4c20-a351-4855bdabb258 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.318236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5d3a0-64fa-4c20-a351-4855bdabb258 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.318974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5d3a0-64fa-4c20-a351-4855bdabb258 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:08.319289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5d3a0-64fa-4c20-a351-4855bdabb258 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:08.320736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5d3a0-64fa-4c20-a351-4855bdabb258 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:08.343985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 404/789] 10.222.0.88 () {56 vars in 1149 bytes} [Fri Aug 26 00:26:08 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:08.343985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8219b-f7e1-40da-9b4b-8ecf0c0066f4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.343985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8219b-f7e1-40da-9b4b-8ecf0c0066f4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.343985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8219b-f7e1-40da-9b4b-8ecf0c0066f4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.343985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 405/790] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:08.343985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8219b-f7e1-40da-9b4b-8ecf0c0066f4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:08.428359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631068a-a4fa-4b10-bfa1-4bef17aa10be None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.439558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:08.440099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:08.462509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8219b-f7e1-40da-9b4b-8ecf0c0066f4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.468189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.469220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.469694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.470238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.471189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:08.471499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:08.472943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:08.492909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 386/791] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:08.492909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:08.510089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bb65d-0b9e-464e-ad55-da0442cfa5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.510998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb65d-0b9e-464e-ad55-da0442cfa5c2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.511448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb65d-0b9e-464e-ad55-da0442cfa5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.511893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bb65d-0b9e-464e-ad55-da0442cfa5c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.512686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb65d-0b9e-464e-ad55-da0442cfa5c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:08.513047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb65d-0b9e-464e-ad55-da0442cfa5c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:08.514899 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70bb65d-0b9e-464e-ad55-da0442cfa5c2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:08.523907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 406/792] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:08.525422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf494-3b4a-49db-9bf3-9e2c6d3c2d17 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.525752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf494-3b4a-49db-9bf3-9e2c6d3c2d17 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.526009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96adf494-3b4a-49db-9bf3-9e2c6d3c2d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.544969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-96adf494-3b4a-49db-9bf3-9e2c6d3c2d17 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:08.546933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-96adf494-3b4a-49db-9bf3-9e2c6d3c2d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:08.628369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aaa81e-6f20-45a6-9a5f-f6517d174788 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.638249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 407/793] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:08.640106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf494-3b4a-49db-9bf3-9e2c6d3c2d17 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:08.669370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.670189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.670544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.671432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.683861 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:08.685444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:08.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:08.706454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:08.707350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:08.707350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:08.707350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:08.711722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 387/794] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:08.712781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:08.754901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:08.853182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1dcb5-cc98-470d-8193-01ebc26a9528 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.893283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:08.894724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.896430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.896788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.897136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.910243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:08.911847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:08.927509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:08.928537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:08.929721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:08.929721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:08.929721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:08.929721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 388/795] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:08.930609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:08.938703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96adf494-3b4a-49db-9bf3-9e2c6d3c2d17 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:08.985679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906126a1-998c-4c36-8dd7-4e99f4341d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:08.986875 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906126a1-998c-4c36-8dd7-4e99f4341d0d None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:08.987435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906126a1-998c-4c36-8dd7-4e99f4341d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:08.988001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906126a1-998c-4c36-8dd7-4e99f4341d0d None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/81ac50ea01de4a9d9b76befbcba88845/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:08.991770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906126a1-998c-4c36-8dd7-4e99f4341d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=81ac50ea01de4a9d9b76befbcba88845, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:08.995212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906126a1-998c-4c36-8dd7-4e99f4341d0d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.013966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 408/796] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:26:08 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/81ac50ea01de4a9d9b76befbcba88845/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:26:09.014908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906126a1-998c-4c36-8dd7-4e99f4341d0d None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.018893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:09.054378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad52a7-0d82-41d4-97bf-8569c49457fe None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.097296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.098130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.098517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.098932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.099760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:09.100186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.101806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.118352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 389/797] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:09.119473 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.208693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906126a1-998c-4c36-8dd7-4e99f4341d0d None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.255056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:09.261136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.261952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.262395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.262773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.263468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.265451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.267272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e53fb-7104-4a40-a8e0-f9d1d6627d9f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:09.275214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:09.276380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 26 00:26:09.277356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:09.279243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 409/798] 10.222.0.88 () {56 vars in 1129 bytes} [Fri Aug 26 00:26:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:09.280156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.317397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.318055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.318340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.318613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.319267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:09.319572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.322021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.330210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:09.337492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 390/799] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:09.339139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.396624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a541c20-f66a-49c1-a587-c2d4397209c2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.438198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.439679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.439679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.439882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.447741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.449206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:09.461581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:09.462539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:09.463407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 410/800] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:09.463891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.485468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fdd95-37fe-4fa3-bd51-aee7a1638cdb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.526696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:09.532918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.533853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.534483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.534925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.536311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:09.536767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.538322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.550411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 391/801] 10.222.0.88 () {56 vars in 1124 bytes} [Fri Aug 26 00:26:09 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:09.552129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.587213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d6613-79b3-4f5f-ae69-e1b76bfdffbb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.630455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:09.633207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.634467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.634863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.635212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.645848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.648529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:09.663940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:09.666885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:26:09.667845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:09.669953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 411/802] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:09.671051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.699955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22beb3a2-dfb8-419f-8941-25f3cacc36f1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.745829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.746532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.746858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.747142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.747862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:09.748225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.750690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.766540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 392/803] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:09.766540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.803315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e5cc3-7305-41ed-a4e4-0a33a9b87e7a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.822815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:09.845905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e87be1-6e7e-47d1-93e0-208a48a4d117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.846617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87be1-6e7e-47d1-93e0-208a48a4d117 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.846953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87be1-6e7e-47d1-93e0-208a48a4d117 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.847159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e87be1-6e7e-47d1-93e0-208a48a4d117 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.847753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87be1-6e7e-47d1-93e0-208a48a4d117 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:09.848058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87be1-6e7e-47d1-93e0-208a48a4d117 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.849435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e87be1-6e7e-47d1-93e0-208a48a4d117 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.859792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 412/804] 10.222.0.88 () {56 vars in 1124 bytes} [Fri Aug 26 00:26:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:09.859792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009b24-be6a-4dc1-9fa5-8f8f43b657be None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.859792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009b24-be6a-4dc1-9fa5-8f8f43b657be None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.859792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009b24-be6a-4dc1-9fa5-8f8f43b657be None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.859792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 413/805] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:09.859792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009b24-be6a-4dc1-9fa5-8f8f43b657be None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.899085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e514bde-76ae-4564-8794-feca23b7b386 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:09.921666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:09.943442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:09.944091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:09.944377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:09.944661 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:09.945409 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:09.945724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:09.947200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:09.966975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 393/806] 10.222.0.88 () {56 vars in 1135 bytes} [Fri Aug 26 00:26:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:09.967659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:09.991550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009b24-be6a-4dc1-9fa5-8f8f43b657be None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:10.032942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9b9e5-9fc6-4ce0-8add-913f3aeb0026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:10.033818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9b9e5-9fc6-4ce0-8add-913f3aeb0026 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:10.034268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9b9e5-9fc6-4ce0-8add-913f3aeb0026 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:10.034559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9b9e5-9fc6-4ce0-8add-913f3aeb0026 None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/902b00eca0fa4008b98205dfc26f4a6e/roles/b488fca06c5144f48db762c7a2ab776b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:10.053037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9b9e5-9fc6-4ce0-8add-913f3aeb0026 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=902b00eca0fa4008b98205dfc26f4a6e, role_id=b488fca06c5144f48db762c7a2ab776b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:10.054808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9b9e5-9fc6-4ce0-8add-913f3aeb0026 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:10.074455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 414/807] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:26:09 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/902b00eca0fa4008b98205dfc26f4a6e/roles/b488fca06c5144f48db762c7a2ab776b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:26:10.087380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ade79e-8e89-47b0-94b8-97840720103f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:10.087662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ade79e-8e89-47b0-94b8-97840720103f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:10.087786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bdbdc-8c19-438c-a9f9-c0aade19fad5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:10.087941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ade79e-8e89-47b0-94b8-97840720103f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:10.112596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b6ade79e-8e89-47b0-94b8-97840720103f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:10.114209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b6ade79e-8e89-47b0-94b8-97840720103f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:10.132986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad86b-3529-43d4-bfb9-a4691cdc8267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:10.133660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad86b-3529-43d4-bfb9-a4691cdc8267 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:10.133984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad86b-3529-43d4-bfb9-a4691cdc8267 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:10.134691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad86b-3529-43d4-bfb9-a4691cdc8267 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:10.135119 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad86b-3529-43d4-bfb9-a4691cdc8267 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:10.136702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad86b-3529-43d4-bfb9-a4691cdc8267 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:10.146807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:10.165350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 394/808] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:26:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:10.166600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad86b-3529-43d4-bfb9-a4691cdc8267 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:10.207809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:10.245903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 415/809] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:10.314531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad86b-3529-43d4-bfb9-a4691cdc8267 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:10.360471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:10.361332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:10.361716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:10.362117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:10.377981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:10.379595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:10.397036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:10.398150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:10.399064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:10.399064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:10.399064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:10.399603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 395/810] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:10.406121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ade79e-8e89-47b0-94b8-97840720103f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:10.522176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ade79e-8e89-47b0-94b8-97840720103f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:10.561262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:10.563119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:10.563608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:10.564083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:10.565007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:10.565529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:10.567166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:10.576217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:10.583409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 416/811] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:10.588963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:10.609095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:10.690668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:10.719125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5400c1-f396-4f86-92d7-2a8074bfb82f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:10.719973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7fc4f4-a971-4f28-9ef9-c4311367b10c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:10.778342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:10.780944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:10.781637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:10.782737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:10.793931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:10.796555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:10.797812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:10.798312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:10.798794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:10.799572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:10.801223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:10.802797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:10.821498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:10.822565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 26 00:26:10.823400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:10.829243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 396/812] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:10 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:10.833609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:10.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:10.835413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:10.835413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:10.835413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:10.835413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:10.835413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:10.835413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:10.835413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:10.835413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:10.837195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:10.839088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 417/813] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:10.851084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:11.019445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:11.043640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63201e-a847-48da-85a0-47687bdd1cc0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:11.067518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9658a4-e332-448b-a2be-6cd65851dcbc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:11.114478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:11.115010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:11.115290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:11.115563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:11.116203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:11.116505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:11.132179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:11.136254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:11.136871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:11.137202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:11.137478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:11.138199 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:11.138547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:11.140284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:11.144284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 397/814] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:10 2022] GET /identity/v3/services?name=network => generated 124 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:11.149595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:11.153844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 418/815] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:11.160282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:11.182740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:11.279177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac8211-1073-4e16-a174-5caa4cba06d0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:11.285910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620487ac-a63b-4cae-b354-d217d7c9224c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:11.325725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b52f80-1fcc-489c-a843-9e812fee8590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:11.326657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52f80-1fcc-489c-a843-9e812fee8590 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:11.326935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52f80-1fcc-489c-a843-9e812fee8590 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:11.327565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6b2c-759e-413d-a4ad-cc4471b09f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:11.327763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b52f80-1fcc-489c-a843-9e812fee8590 None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/c266ac5c785d46488a1a1560283ba4fa/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:11.328431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6b2c-759e-413d-a4ad-cc4471b09f20 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:11.328864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6b2c-759e-413d-a4ad-cc4471b09f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:11.329150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6b2c-759e-413d-a4ad-cc4471b09f20 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:11.329829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6b2c-759e-413d-a4ad-cc4471b09f20 None admin] RBAC: Adding query filter params (type=network) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:11.330030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b52f80-1fcc-489c-a843-9e812fee8590 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=c266ac5c785d46488a1a1560283ba4fa, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:11.330204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6b2c-759e-413d-a4ad-cc4471b09f20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:11.331358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b52f80-1fcc-489c-a843-9e812fee8590 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:11.331547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead6b2c-759e-413d-a4ad-cc4471b09f20 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:11.335195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:11.339848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 398/816] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:11.341914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084703f-09c7-4bf4-95ae-2db0221112b8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:11.342479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084703f-09c7-4bf4-95ae-2db0221112b8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:11.343591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084703f-09c7-4bf4-95ae-2db0221112b8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:11.352598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 419/818] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:26:11 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/c266ac5c785d46488a1a1560283ba4fa/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:26:11.352598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b52f80-1fcc-489c-a843-9e812fee8590 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:11.352967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 399/818] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:11.363630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3378b2-75a2-4ef2-bb2a-26afef17e990 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:11.364237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3378b2-75a2-4ef2-bb2a-26afef17e990 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:11.364733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3378b2-75a2-4ef2-bb2a-26afef17e990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:11.403958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5c3378b2-75a2-4ef2-bb2a-26afef17e990 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:11.405641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5c3378b2-75a2-4ef2-bb2a-26afef17e990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:11.476277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b52f80-1fcc-489c-a843-9e812fee8590 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:11.519289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb95bec-df3e-487a-92ed-8b90068d7561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:11.520024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb95bec-df3e-487a-92ed-8b90068d7561 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:11.520373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb95bec-df3e-487a-92ed-8b90068d7561 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:11.520715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb95bec-df3e-487a-92ed-8b90068d7561 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:11.522068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb95bec-df3e-487a-92ed-8b90068d7561 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:11.523865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb95bec-df3e-487a-92ed-8b90068d7561 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:11.549797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 420/819] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:26:11 2022] POST /identity/v3/endpoints => generated 337 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:11.592364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 400/820] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 26 00:26:11.927086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb95bec-df3e-487a-92ed-8b90068d7561 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:11.996451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:12.069224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb95bec-df3e-487a-92ed-8b90068d7561 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:12.109516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee734-237f-433a-a771-a8c8532443d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:12.110578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee734-237f-433a-a771-a8c8532443d6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.111087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee734-237f-433a-a771-a8c8532443d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.111583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee734-237f-433a-a771-a8c8532443d6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.127195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ee734-237f-433a-a771-a8c8532443d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-194ee734-237f-433a-a771-a8c8532443d6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:12.135181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:12.136259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:12.137120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:12.140640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 421/821] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:12.146845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3378b2-75a2-4ef2-bb2a-26afef17e990 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:12.149788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:12.263766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3378b2-75a2-4ef2-bb2a-26afef17e990 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:12.303357 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb24a-ee51-4dab-8c4a-837d63dea2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:12.304612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb24a-ee51-4dab-8c4a-837d63dea2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.305165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb24a-ee51-4dab-8c4a-837d63dea2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.305646 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb24a-ee51-4dab-8c4a-837d63dea2b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.306566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb24a-ee51-4dab-8c4a-837d63dea2b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:12.307079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb24a-ee51-4dab-8c4a-837d63dea2b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:12.308654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb24a-ee51-4dab-8c4a-837d63dea2b6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:12.319001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 401/822] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:12.324992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee734-237f-433a-a771-a8c8532443d6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:12.379710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13894f0a-1966-47b7-95f0-9864e5287ce4 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.380039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13894f0a-1966-47b7-95f0-9864e5287ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.380267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13894f0a-1966-47b7-95f0-9864e5287ce4 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.381727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 402/823] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:12.387970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c03de-e8dd-428f-b0a2-f67e7cd1a6fe None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.388250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c03de-e8dd-428f-b0a2-f67e7cd1a6fe None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.388529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c03de-e8dd-428f-b0a2-f67e7cd1a6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.410912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e65c03de-e8dd-428f-b0a2-f67e7cd1a6fe None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:12.412295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e65c03de-e8dd-428f-b0a2-f67e7cd1a6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:12.455144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee734-237f-433a-a771-a8c8532443d6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:12.474236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:12.492457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:12.504960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:12.506026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.506519 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.507022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.509857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 403/824] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:12.521146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:12.523065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:12.539563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:12.541159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:12.542362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:12.542362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:12.542362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:12.544477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 422/825] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:12.551086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c03de-e8dd-428f-b0a2-f67e7cd1a6fe None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:12.667321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c03de-e8dd-428f-b0a2-f67e7cd1a6fe None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:12.705315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21ebb63-1270-4b66-92c9-8be653f2cef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:12.705963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ebb63-1270-4b66-92c9-8be653f2cef4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.706298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ebb63-1270-4b66-92c9-8be653f2cef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.706594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ebb63-1270-4b66-92c9-8be653f2cef4 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.707256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ebb63-1270-4b66-92c9-8be653f2cef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:12.707565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ebb63-1270-4b66-92c9-8be653f2cef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:12.708946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21ebb63-1270-4b66-92c9-8be653f2cef4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:12.722700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 404/826] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:12.728449 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:12.779031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ba83-48ae-4d6b-ba42-68f17a6d8d18 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.779292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ba83-48ae-4d6b-ba42-68f17a6d8d18 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.779551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ba83-48ae-4d6b-ba42-68f17a6d8d18 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.781268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 405/827] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:12.786424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9827-86d2-4757-ab6d-83384a921583 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.786713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9827-86d2-4757-ab6d-83384a921583 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.786995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e9827-86d2-4757-ab6d-83384a921583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.808203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fe5e9827-86d2-4757-ab6d-83384a921583 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:12.809425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fe5e9827-86d2-4757-ab6d-83384a921583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:12.858025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f7e84-6d73-4190-8353-a8fd00d2b199 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:12.864348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:12.889957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 406/828] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:12.889957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e9827-86d2-4757-ab6d-83384a921583 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:12.903853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:12.904641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:12.905435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:12.905896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:12.916873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:12.919437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:12.935696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:12.937264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:12.938219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:12.942781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 423/829] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:26:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:12.943691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:12.986368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:13.016871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e9827-86d2-4757-ab6d-83384a921583 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.065788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3838f-d670-4b52-811b-7ee9770e45cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.066387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3838f-d670-4b52-811b-7ee9770e45cf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.066673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3838f-d670-4b52-811b-7ee9770e45cf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.066952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c3838f-d670-4b52-811b-7ee9770e45cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.081936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c3838f-d670-4b52-811b-7ee9770e45cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e3c3838f-d670-4b52-811b-7ee9770e45cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:13.088313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:13.089240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:13.094636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 407/830] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:26:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:13.096527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3838f-d670-4b52-811b-7ee9770e45cf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.096807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad51177-1ae2-4d4d-b889-afa7796eed2e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.136606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.137388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.137759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.138152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.139045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:13.140421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.142051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.167004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 424/831] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:26:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:13.168916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:13.169370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.231493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c3838f-d670-4b52-811b-7ee9770e45cf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.263073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:13.274493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.275105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.275385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.275655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.276428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:13.276750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.278161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.285448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78e09-a2b0-4ef1-b209-942831adad65 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.292408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 408/832] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:13.293219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.324403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd0fc-143a-46df-b8d9-5035b1f79946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.324907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd0fc-143a-46df-b8d9-5035b1f79946 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.325198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd0fc-143a-46df-b8d9-5035b1f79946 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.325472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ebd0fc-143a-46df-b8d9-5035b1f79946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.406457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ebce8-3efb-430c-946a-43a9030dc975 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.407153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebd0fc-143a-46df-b8d9-5035b1f79946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.408632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ebd0fc-143a-46df-b8d9-5035b1f79946 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.414533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:13.448970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.450020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.450531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.451000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.453126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.455248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:13.467331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:13.468962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:13.469785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 409/833] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:13.470599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.506019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:13.529085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 425/834] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:26:13.534870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd0fc-143a-46df-b8d9-5035b1f79946 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.588137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dd0cd-f57e-4fc1-89ce-9151524903a0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.625176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.625815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.626124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.626400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.638761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.640396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.653084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ebd0fc-143a-46df-b8d9-5035b1f79946 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:13.654554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:13.656002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:13.659139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:13.659139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:13.659139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:13.659139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 410/835] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:13.659139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.686053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:13.691559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be1474-277b-4d22-bda3-fd2c4f85e9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.692171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be1474-277b-4d22-bda3-fd2c4f85e9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.692450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be1474-277b-4d22-bda3-fd2c4f85e9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.692719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be1474-277b-4d22-bda3-fd2c4f85e9b4 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.693347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be1474-277b-4d22-bda3-fd2c4f85e9b4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:13.693654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be1474-277b-4d22-bda3-fd2c4f85e9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.695064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7be1474-277b-4d22-bda3-fd2c4f85e9b4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.700407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 426/836] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:13.701595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bca1e-f9d2-400c-bc0f-28c416bf7618 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.701926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bca1e-f9d2-400c-bc0f-28c416bf7618 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.702187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70bca1e-f9d2-400c-bc0f-28c416bf7618 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.703532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 427/837] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:13.704231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bca1e-f9d2-400c-bc0f-28c416bf7618 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.755857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:13.769645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c94b51-c476-484c-a54a-54505f3fd9f4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.805531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760981-3906-416e-869e-62ee22b8202b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.806198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760981-3906-416e-869e-62ee22b8202b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.806485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760981-3906-416e-869e-62ee22b8202b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.806765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22760981-3906-416e-869e-62ee22b8202b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.813650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70bca1e-f9d2-400c-bc0f-28c416bf7618 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.818062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22760981-3906-416e-869e-62ee22b8202b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.819517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22760981-3906-416e-869e-62ee22b8202b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-22760981-3906-416e-869e-62ee22b8202b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:13.833925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:13.834867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:13.835763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:13.835763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:13.835763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:13.835763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 411/838] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:13.835994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760981-3906-416e-869e-62ee22b8202b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.851041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45436b88-76e5-4be6-880a-694dab5357e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.851657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436b88-76e5-4be6-880a-694dab5357e6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.851942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436b88-76e5-4be6-880a-694dab5357e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.852222 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436b88-76e5-4be6-880a-694dab5357e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.852869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45436b88-76e5-4be6-880a-694dab5357e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:13.853177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45436b88-76e5-4be6-880a-694dab5357e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.854642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45436b88-76e5-4be6-880a-694dab5357e6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.867108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 428/839] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:13.868440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdfd5-762c-4197-8a95-0c928f6ca435 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.868852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdfd5-762c-4197-8a95-0c928f6ca435 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.869152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cdfd5-762c-4197-8a95-0c928f6ca435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.887918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-965cdfd5-762c-4197-8a95-0c928f6ca435 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:13.889164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-965cdfd5-762c-4197-8a95-0c928f6ca435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:13.914333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:13.940396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22760981-3906-416e-869e-62ee22b8202b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:13.957422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 429/840] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:13 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:13.958640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cdfd5-762c-4197-8a95-0c928f6ca435 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:13.989634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:13.990557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:13.991006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:13.991429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:13.992272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:13.992752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:13.994321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:13.994947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:14.006601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 412/841] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:14.006601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.082983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cdfd5-762c-4197-8a95-0c928f6ca435 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.135415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.136307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.136849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.137268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.138254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:14.138739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:14.141254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:14.149700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db5a6c-e13b-4b42-9162-0c3540f25a0d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.155665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 430/842] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:14.162489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.199072 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.199880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.200270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.200558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.213931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:14.213931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:14.214246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:14.226697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:14.228104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:14.229306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 413/843] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:14.234422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.298634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:14.305166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47280286-d90f-4026-8ce5-3e27b72a2732 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.347856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.348495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.348800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.349059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.356386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:14.357903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:14.362819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fde947-3fc3-4a85-9d7a-16346ab124ab None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:14.371426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:14.372429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:14.373430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 431/844] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:14.375292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.406256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.406696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.406980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.407329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.407996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:14.408301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:14.409749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:14.430485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 414/845] 10.222.0.88 () {56 vars in 1149 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:14.431680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.491666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c228f71-1195-4d38-ae88-d59b729db454 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.495608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:14.534878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ded4ce-b35c-4758-bb56-863a3a5d9a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.535705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ded4ce-b35c-4758-bb56-863a3a5d9a7c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.535925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ded4ce-b35c-4758-bb56-863a3a5d9a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.536497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ded4ce-b35c-4758-bb56-863a3a5d9a7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.548910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ded4ce-b35c-4758-bb56-863a3a5d9a7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:14.552971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7068a214-26d5-4b3a-91f9-a57a32bd1e66 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c0ded4ce-b35c-4758-bb56-863a3a5d9a7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:14.558740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:14.560056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 432/846] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:14.561024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ded4ce-b35c-4758-bb56-863a3a5d9a7c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.592020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:14.603747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.604368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.604654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.604977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.605736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:14.606052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:14.607729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:14.620099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 415/847] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:14.625812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.698300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ded4ce-b35c-4758-bb56-863a3a5d9a7c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.742054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250324b8-7ba4-4954-a5c0-985faa85cf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.742935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250324b8-7ba4-4954-a5c0-985faa85cf6e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.743389 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250324b8-7ba4-4954-a5c0-985faa85cf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.743963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250324b8-7ba4-4954-a5c0-985faa85cf6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.749790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b44d0-c5a4-4a1a-9cd9-be6cac2f3312 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.768272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:14.791279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.791896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.792180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.792455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.793128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:14.793431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:14.794846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:14.805151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 416/848] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:14.807582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.830333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250324b8-7ba4-4954-a5c0-985faa85cf6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:14.831934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250324b8-7ba4-4954-a5c0-985faa85cf6e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:14.853098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:14.921708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f058e43-0186-416c-807d-1d64d6c4ab89 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:14.959749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 433/849] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:26:14.959749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250324b8-7ba4-4954-a5c0-985faa85cf6e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:14.965232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:14.965986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:14.966564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:14.966937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:14.968413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=81ac50ea01de4a9d9b76befbcba88845) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:14.968718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:14.970490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:14.977448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 417/850] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/role_assignments?user.id=81ac50ea01de4a9d9b76befbcba88845&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=f21c9b5697b747d39bf8f104797da245 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:14.978550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.044100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:15.102730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250324b8-7ba4-4954-a5c0-985faa85cf6e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:15.123747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:15.148815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:15.149060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cf2e5-0edd-42e2-a830-beb26e6954aa None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:15.149996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:15.150478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:15.150999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:15.166342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:15.169745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:15.188221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:15.189205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:15.190121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:15.190121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:15.190121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:15.191908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 434/851] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:15.197938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.200900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:15.202155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:15.202616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:15.203162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:15.216719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:15.219718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:15.240572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:15.241828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:15.242753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:15.242753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:15.242753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:15.242753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 418/852] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:15.248477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.342294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac253b-bbd3-4a8b-bb30-a2848e914aef None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:15.378948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:15.390055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e5bd5-5643-4a4c-99d6-8bc5a8684cf0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:15.391262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:15.392470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:15.392867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:15.393167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:15.395260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:15.395574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:15.397141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:15.414868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 435/853] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:15.421285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.441334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:15.442115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:15.442553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:15.442910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:15.443618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:15.444076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:15.445477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:15.458633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:15.467896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 419/854] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:15.469190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.566124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bfe85-6ce7-447f-a9ac-730859bbc300 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:15.605042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5a46b0-d534-4bf4-aff5-62b11982a9ad None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:15.616367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:15.617300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:15.617694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:15.618605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:15.630860 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:15.632922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:15.648602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:15.649588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:15.650555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 436/855] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:15.651892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:15.652159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:15.656623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:15.656623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:15.657850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.667118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:15.668926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:15.684470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:15.685417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:15.686351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 420/856] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:15.693229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.716656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:15.797301 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:15.817558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dfc089-2eca-4b88-a0b6-2e1e7ca1c7f3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:15.834003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996415be-0152-4620-be1b-ef906d10c80b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:15.869443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:15.869798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:15.870200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:15.870658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:15.871490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:15.871900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:15.874303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:15.875107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:15.875873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:15.876307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:15.876759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:15.877631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:15.878207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:15.879868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:15.893839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 421/857] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:15.899915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.905995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 437/858] 10.222.0.88 () {56 vars in 1135 bytes} [Fri Aug 26 00:26:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:15.907471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:15.998194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:16.027315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4096419d-e9d0-4443-a4e6-e92203a94d96 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:16.039026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f8bb8e-b047-42ef-9f87-1cbff71bbfc6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:16.071921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2653abe-6886-472a-a002-c4dedd923b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:16.072887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653abe-6886-472a-a002-c4dedd923b87 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:16.073378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653abe-6886-472a-a002-c4dedd923b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:16.073901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2653abe-6886-472a-a002-c4dedd923b87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:16.074946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653abe-6886-472a-a002-c4dedd923b87 None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=902b00eca0fa4008b98205dfc26f4a6e) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:16.075469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653abe-6886-472a-a002-c4dedd923b87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:16.077359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2653abe-6886-472a-a002-c4dedd923b87 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:16.079657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5068f4d-7e36-41e5-a61f-430196e2833f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:16.080276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068f4d-7e36-41e5-a61f-430196e2833f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:16.080560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068f4d-7e36-41e5-a61f-430196e2833f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:16.080834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5068f4d-7e36-41e5-a61f-430196e2833f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:16.084739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 422/859] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:15 2022] GET /identity/v3/role_assignments?user.id=902b00eca0fa4008b98205dfc26f4a6e&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:16.086226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1acb0-b130-4637-b98a-f73cd986b8b9 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:16.086720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1acb0-b130-4637-b98a-f73cd986b8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:16.087220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1acb0-b130-4637-b98a-f73cd986b8b9 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:16.088906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 423/860] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:16.099692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568755f-f283-407d-9894-5bddee82b503 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:16.099692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568755f-f283-407d-9894-5bddee82b503 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:16.099692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5568755f-f283-407d-9894-5bddee82b503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:16.112962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:16.116312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5568755f-f283-407d-9894-5bddee82b503 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:16.117545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5568755f-f283-407d-9894-5bddee82b503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:16.191342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068f4d-7e36-41e5-a61f-430196e2833f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:16.193654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5068f4d-7e36-41e5-a61f-430196e2833f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:16.204793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 424/861] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:16.313975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 438/862] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:15 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:26:16.319731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568755f-f283-407d-9894-5bddee82b503 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:16.399344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:16.440327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5568755f-f283-407d-9894-5bddee82b503 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:16.477367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:16.478037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:16.478313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:16.478584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:16.490224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:16.491782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:16.492886 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5068f4d-7e36-41e5-a61f-430196e2833f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:16.508758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:16.509794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:16.510735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:16.510735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:16.510735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:16.510735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 425/863] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:16.518933 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:16.548159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:16.619926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5068f4d-7e36-41e5-a61f-430196e2833f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:16.656578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e18d-355b-43b8-b65d-1e4d726e2e49 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:16.664553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2af75-ef82-49d2-a4b4-615f8498d5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:16.665491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2af75-ef82-49d2-a4b4-615f8498d5bc None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:16.666612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2af75-ef82-49d2-a4b4-615f8498d5bc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:16.667186 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2af75-ef82-49d2-a4b4-615f8498d5bc None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:16.668706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2af75-ef82-49d2-a4b4-615f8498d5bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:16.671164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec2af75-ef82-49d2-a4b4-615f8498d5bc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:16.682075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:16.696007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 439/864] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:26:16 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:16.714490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:16.715533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:16.716054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:16.716575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:16.718099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:16.718862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:16.720633 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:16.736965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 426/865] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:16.743085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2af75-ef82-49d2-a4b4-615f8498d5bc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:16.868849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2af75-ef82-49d2-a4b4-615f8498d5bc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:16.878196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:16.910400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:16.911556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:16.912045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:16.912520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:16.921267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:16.923249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:16.936581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:16.937547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:16.938481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:16.938481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:16.938481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:16.938481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:16.938481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:16.938481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:16.938481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:16.938481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:16.941002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 440/866] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:16.947053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:17.058638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0437e-1486-4642-a963-9a1023289d9f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:17.109403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6decd5f0-9f72-4d87-afdc-8a1276c6db15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:17.110434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decd5f0-9f72-4d87-afdc-8a1276c6db15 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:17.110938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decd5f0-9f72-4d87-afdc-8a1276c6db15 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:17.111413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6decd5f0-9f72-4d87-afdc-8a1276c6db15 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:17.112448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decd5f0-9f72-4d87-afdc-8a1276c6db15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:17.112958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decd5f0-9f72-4d87-afdc-8a1276c6db15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:17.114640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6decd5f0-9f72-4d87-afdc-8a1276c6db15 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:17.127948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 427/867] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:17.134277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:17.156241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e299c1-f81d-4cc8-8816-6656ccc2eed2 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:17.156666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e299c1-f81d-4cc8-8816-6656ccc2eed2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:17.156907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e299c1-f81d-4cc8-8816-6656ccc2eed2 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:17.164338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 428/868] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:17.165634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa92dc-b2d5-4be1-a442-306bcb14662b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:17.166067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa92dc-b2d5-4be1-a442-306bcb14662b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:17.166352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa92dc-b2d5-4be1-a442-306bcb14662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:17.188531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fefa92dc-b2d5-4be1-a442-306bcb14662b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:17.189761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fefa92dc-b2d5-4be1-a442-306bcb14662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:17.223246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:17.257844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd50b5-fac6-40d5-ab70-592ef24db46b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:17.273862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 429/869] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:17 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:17.301465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:17.302115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:17.302405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:17.302686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:17.303738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=c266ac5c785d46488a1a1560283ba4fa) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:17.304054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:17.305563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:17.313132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 441/870] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:17 2022] GET /identity/v3/role_assignments?user.id=c266ac5c785d46488a1a1560283ba4fa&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=f21c9b5697b747d39bf8f104797da245 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:17.552794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa92dc-b2d5-4be1-a442-306bcb14662b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:17.663650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa92dc-b2d5-4be1-a442-306bcb14662b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:17.702767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:17.703413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:17.703700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:17.703981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:17.704577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:17.705982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:17.715270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:17.716226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:17.717108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 430/871] 10.222.0.88 () {56 vars in 1132 bytes} [Fri Aug 26 00:26:17 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:17.723576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:17.760155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:17.852323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b96e8e-ebb7-45b7-9a31-4515624cd771 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:17.890548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31970005-209c-4489-a5c1-744e359be900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:17.892037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31970005-209c-4489-a5c1-744e359be900 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:17.892524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31970005-209c-4489-a5c1-744e359be900 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:17.892997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31970005-209c-4489-a5c1-744e359be900 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:17.893832 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31970005-209c-4489-a5c1-744e359be900 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:17.894378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31970005-209c-4489-a5c1-744e359be900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:17.895968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31970005-209c-4489-a5c1-744e359be900 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:17.901535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 442/872] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:17.907366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:17.942306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:18.032266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6f11b-b7bb-4619-9f03-e47b9b25db60 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:18.074895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b09faf-74e4-4f27-b122-7bdeb56c9f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:18.075537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09faf-74e4-4f27-b122-7bdeb56c9f18 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:18.075838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09faf-74e4-4f27-b122-7bdeb56c9f18 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:18.076137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b09faf-74e4-4f27-b122-7bdeb56c9f18 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:18.077486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b09faf-74e4-4f27-b122-7bdeb56c9f18 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:18.077893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b09faf-74e4-4f27-b122-7bdeb56c9f18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:18.079279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b09faf-74e4-4f27-b122-7bdeb56c9f18 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:18.084851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 431/873] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:17 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:18.299837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33806bd4-e079-4cf5-ae23-1cbe79cd4661 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:18.300118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33806bd4-e079-4cf5-ae23-1cbe79cd4661 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:18.300375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33806bd4-e079-4cf5-ae23-1cbe79cd4661 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:18.302017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 443/874] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:18.307869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cca9ed-faad-4a33-80e1-e4696b2f7904 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:18.308451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cca9ed-faad-4a33-80e1-e4696b2f7904 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:18.308451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cca9ed-faad-4a33-80e1-e4696b2f7904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:18.328718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-98cca9ed-faad-4a33-80e1-e4696b2f7904 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:18.329941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-98cca9ed-faad-4a33-80e1-e4696b2f7904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:18.407500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 432/875] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:18.690180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33806bd4-e079-4cf5-ae23-1cbe79cd4661 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:18.798778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:18.808503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33806bd4-e079-4cf5-ae23-1cbe79cd4661 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:18.844592 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4314bf-6967-4bc0-9a5c-e4fa99787cd3 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:18.844881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4314bf-6967-4bc0-9a5c-e4fa99787cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:18.845065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4314bf-6967-4bc0-9a5c-e4fa99787cd3 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:18.846692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 433/876] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:18.850602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efcb20-6fe6-42c1-af55-b9cc6ccdb5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:18.851533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcb20-6fe6-42c1-af55-b9cc6ccdb5b2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:18.851654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2a66d-4bd1-4e9d-8a84-86a3bf878eb4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:18.851888 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2a66d-4bd1-4e9d-8a84-86a3bf878eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:18.852166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a2a66d-4bd1-4e9d-8a84-86a3bf878eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:18.852535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcb20-6fe6-42c1-af55-b9cc6ccdb5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:18.853019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efcb20-6fe6-42c1-af55-b9cc6ccdb5b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:18.866010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efcb20-6fe6-42c1-af55-b9cc6ccdb5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-a7efcb20-6fe6-42c1-af55-b9cc6ccdb5b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:18.871201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:18.872115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:18.872934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:18.875203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c8a2a66d-4bd1-4e9d-8a84-86a3bf878eb4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:18.875891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 444/877] 10.222.0.88 () {56 vars in 1120 bytes} [Fri Aug 26 00:26:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:18.876588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c8a2a66d-4bd1-4e9d-8a84-86a3bf878eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:18.882016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efcb20-6fe6-42c1-af55-b9cc6ccdb5b2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:18.897016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:18.975579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 434/878] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:18 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:19.021592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efcb20-6fe6-42c1-af55-b9cc6ccdb5b2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:19.069426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:19.070082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.070365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.070643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.071311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:19.071617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:19.073008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:19.083777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 445/879] 10.222.0.88 () {56 vars in 1115 bytes} [Fri Aug 26 00:26:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:19.089208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2a66d-4bd1-4e9d-8a84-86a3bf878eb4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:19.227147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a2a66d-4bd1-4e9d-8a84-86a3bf878eb4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:19.269824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:19.270279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:19.270495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.270777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.271048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.282121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:19.284632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:19.292993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:19.300481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:19.301479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:19.302398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:19.302398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:19.302398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:19.302398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 435/880] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:19.310889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:19.320589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:19.405600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2008ba2a-79c9-4df9-ae3c-6fd99f0d4741 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:19.444708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76768ab6-f950-49ce-9031-672ce244e215 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:19.448687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eef016-22ec-4cb9-a79b-d0ad9e72715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:19.449482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef016-22ec-4cb9-a79b-d0ad9e72715a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.449840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef016-22ec-4cb9-a79b-d0ad9e72715a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.450232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eef016-22ec-4cb9-a79b-d0ad9e72715a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.450900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eef016-22ec-4cb9-a79b-d0ad9e72715a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:19.452975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eef016-22ec-4cb9-a79b-d0ad9e72715a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-29eef016-22ec-4cb9-a79b-d0ad9e72715a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:19.462827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:19.463868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:19.464678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:19.469919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 446/881] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:19.471433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21ca8-cc8f-412c-bc51-afe7e3e8f2dd None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.471765 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21ca8-cc8f-412c-bc51-afe7e3e8f2dd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.472029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f21ca8-cc8f-412c-bc51-afe7e3e8f2dd None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.473408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 447/882] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:19.474212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21ca8-cc8f-412c-bc51-afe7e3e8f2dd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:19.507174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c97aa-02c7-4280-a246-c90bb9740a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:19.508572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c97aa-02c7-4280-a246-c90bb9740a03 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.509140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c97aa-02c7-4280-a246-c90bb9740a03 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.509660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c97aa-02c7-4280-a246-c90bb9740a03 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.510741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c97aa-02c7-4280-a246-c90bb9740a03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:19.511596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c97aa-02c7-4280-a246-c90bb9740a03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:19.513731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c97aa-02c7-4280-a246-c90bb9740a03 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:19.527987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 436/883] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:19.530832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a8cb1-f9ec-49b3-a132-8d398361caea None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.531386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a8cb1-f9ec-49b3-a132-8d398361caea None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.531851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a8cb1-f9ec-49b3-a132-8d398361caea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.555188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b04a8cb1-f9ec-49b3-a132-8d398361caea None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:19.556676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b04a8cb1-f9ec-49b3-a132-8d398361caea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:19.591527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:19.615486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f21ca8-cc8f-412c-bc51-afe7e3e8f2dd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:19.636958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:19.646313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 437/884] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:19 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:19.650070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a8cb1-f9ec-49b3-a132-8d398361caea None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:19.664158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:19.664841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.665134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.665432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.666206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:19.666623 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:19.668453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:19.674792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 448/885] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:19.680487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:19.782927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a8cb1-f9ec-49b3-a132-8d398361caea None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:19.796963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26758085-bdb6-4b77-9b65-1b28922e58d6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:19.833325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:19.834010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.834289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.834562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.842352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:19.843807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:19.847215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:19.848078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:19.848638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:19.849133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:19.850192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:19.850983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:19.852559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:19.858958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 449/886] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:19.868328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:19.871904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:19.873080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:19.874645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 438/887] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:26:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:19.880267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:19.888273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:19.958862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:20.000933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b64a721-7480-4fae-ac36-c389ff5b1751 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:20.014391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52997d6e-c077-4075-820e-8bb6deb3ffa6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:20.054250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62609c46-870b-4b61-8226-5501650702fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:20.054778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:20.054893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.055146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.055244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62609c46-870b-4b61-8226-5501650702fa None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.055391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.055593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62609c46-870b-4b61-8226-5501650702fa None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.056044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62609c46-870b-4b61-8226-5501650702fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.056147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:20.056424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:20.057373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62609c46-870b-4b61-8226-5501650702fa None admin] RBAC: Adding query filter params (interface=public, service_id=8f1bbbd321d34b5c945dc847d8fbe671, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:20.057864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:20.057995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62609c46-870b-4b61-8226-5501650702fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:20.059807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62609c46-870b-4b61-8226-5501650702fa None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:20.070301 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 450/888] 10.222.0.88 () {56 vars in 1251 bytes} [Fri Aug 26 00:26:19 2022] GET /identity/v3/endpoints?service_id=8f1bbbd321d34b5c945dc847d8fbe671&interface=public®ion_id=RegionOne => generated 194 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:20.070301 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62609c46-870b-4b61-8226-5501650702fa None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:20.091977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 439/889] 10.222.0.88 () {56 vars in 1149 bytes} [Fri Aug 26 00:26:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:20.091977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:20.161247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:20.197578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62609c46-870b-4b61-8226-5501650702fa None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:20.216961 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044e2b-40c8-403f-a23d-5b303382b7ae None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:20.234762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:20.235103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:20.235940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.236426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.236783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.237540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:20.238996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:20.249081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:20.250698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:20.251585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 451/890] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:20.254747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:20.260503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c684d3-336c-4b08-b940-ab85db75d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:20.261205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c684d3-336c-4b08-b940-ab85db75d76a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.261573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c684d3-336c-4b08-b940-ab85db75d76a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.261862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c684d3-336c-4b08-b940-ab85db75d76a None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.262706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c684d3-336c-4b08-b940-ab85db75d76a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:20.264766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c684d3-336c-4b08-b940-ab85db75d76a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:20.270610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 440/891] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:26:20 2022] GET /identity/v3/services => generated 1011 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:26:20.271682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942707a4-940b-4f03-9ef2-68603eedbec0 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.272023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942707a4-940b-4f03-9ef2-68603eedbec0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.272307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942707a4-940b-4f03-9ef2-68603eedbec0 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.273570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 441/892] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:20.275789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942707a4-940b-4f03-9ef2-68603eedbec0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:20.399882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffce3f2-8d1e-4bd2-8aea-70bc7f68fde6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:20.426582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942707a4-940b-4f03-9ef2-68603eedbec0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:20.449937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b58b1-b5f0-48c0-8395-e5728686bf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:20.450558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b58b1-b5f0-48c0-8395-e5728686bf32 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.450850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b58b1-b5f0-48c0-8395-e5728686bf32 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.451128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b58b1-b5f0-48c0-8395-e5728686bf32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.456321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:20.476194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcaf306-7bf6-4f59-9ccc-30c097795297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:20.476812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf306-7bf6-4f59-9ccc-30c097795297 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.477092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf306-7bf6-4f59-9ccc-30c097795297 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.477366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcaf306-7bf6-4f59-9ccc-30c097795297 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.478036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaf306-7bf6-4f59-9ccc-30c097795297 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:20.478349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaf306-7bf6-4f59-9ccc-30c097795297 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:20.480147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcaf306-7bf6-4f59-9ccc-30c097795297 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:20.485766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 442/893] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:20.486809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd6e92-f3d3-4d56-a4d2-e40dbf1640f6 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.487090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd6e92-f3d3-4d56-a4d2-e40dbf1640f6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.487365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd6e92-f3d3-4d56-a4d2-e40dbf1640f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.505550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1ffd6e92-f3d3-4d56-a4d2-e40dbf1640f6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:20.506779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1ffd6e92-f3d3-4d56-a4d2-e40dbf1640f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:20.539274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b58b1-b5f0-48c0-8395-e5728686bf32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:20.540804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b58b1-b5f0-48c0-8395-e5728686bf32 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:20.544336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:20.588012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 443/894] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:20 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:20.589208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd6e92-f3d3-4d56-a4d2-e40dbf1640f6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:20.677400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 452/895] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:20 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:26:20.678430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b58b1-b5f0-48c0-8395-e5728686bf32 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:20.709860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd6e92-f3d3-4d56-a4d2-e40dbf1640f6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:20.726079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:20.751266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:20.752008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.752248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.752527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.753221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:20.753550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:20.754940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:20.759973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 444/896] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:20 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:20.810757 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b58b1-b5f0-48c0-8395-e5728686bf32 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:20.854267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:20.854921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:20.855208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:20.855487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:20.869246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:20.870076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:20.870896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:20.892700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:20.893805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:20.894722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:20.894722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:20.894722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:20.894722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 453/897] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:20.901476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:20.913080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:21.023328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b8eea-5ccf-498d-b924-8030cbd2463d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:21.034065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97cb47-0b86-4cca-8427-074b9ceac0f1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:21.054661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:21.074258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57dff-b1ca-44c0-9124-d59b79f40b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:21.074971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57dff-b1ca-44c0-9124-d59b79f40b59 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:21.075322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57dff-b1ca-44c0-9124-d59b79f40b59 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:21.075662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e57dff-b1ca-44c0-9124-d59b79f40b59 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:21.076383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e57dff-b1ca-44c0-9124-d59b79f40b59 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:21.077820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:21.078464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:21.078582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e57dff-b1ca-44c0-9124-d59b79f40b59 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:21.078746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:21.079026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:21.079684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:21.079988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:21.081358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:21.100067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 445/899] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:26:20 2022] POST /identity/v3/services => generated 269 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:26:21.101960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 454/899] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:21.104478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57dff-b1ca-44c0-9124-d59b79f40b59 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:21.231501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:21.245197 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e57dff-b1ca-44c0-9124-d59b79f40b59 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:21.286738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:21.287303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:21.287587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:21.287864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:21.295454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:21.297287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:21.309645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:21.310629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:21.311891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 446/900] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:21.318734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:21.444000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83971f9f-f989-4102-8de7-3a62f63d320c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:21.487179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cde23d-1620-4602-8f97-1ecea7eb9d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:21.487848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cde23d-1620-4602-8f97-1ecea7eb9d5d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:21.488136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cde23d-1620-4602-8f97-1ecea7eb9d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:21.488411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cde23d-1620-4602-8f97-1ecea7eb9d5d None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:21.489109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cde23d-1620-4602-8f97-1ecea7eb9d5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:21.489419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cde23d-1620-4602-8f97-1ecea7eb9d5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:21.491160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cde23d-1620-4602-8f97-1ecea7eb9d5d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:21.505665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 455/901] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:21.512545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:21.626938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e31630-15b6-44c5-89e5-ba2ee912610e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:21.663852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ddcc29-51f7-47a0-9acf-f9213bfb60d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:21.664476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcc29-51f7-47a0-9acf-f9213bfb60d9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:21.664760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcc29-51f7-47a0-9acf-f9213bfb60d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:21.665038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ddcc29-51f7-47a0-9acf-f9213bfb60d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:21.665773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddcc29-51f7-47a0-9acf-f9213bfb60d9 None admin] RBAC: Adding query filter params (role.id=78c5de78f20944078beaf3ec85795d46, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=902b00eca0fa4008b98205dfc26f4a6e) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:21.666113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddcc29-51f7-47a0-9acf-f9213bfb60d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:21.667667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ddcc29-51f7-47a0-9acf-f9213bfb60d9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:21.674663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 447/902] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:21 2022] GET /identity/v3/role_assignments?user.id=902b00eca0fa4008b98205dfc26f4a6e&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=78c5de78f20944078beaf3ec85795d46 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:22.377987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a75010-73e5-487a-8f28-379bf521bc51 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:22.378605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a75010-73e5-487a-8f28-379bf521bc51 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:22.378605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a75010-73e5-487a-8f28-379bf521bc51 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:22.380328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 456/903] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:22.385807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a38dd-8430-4ec4-91e5-6e1ada078283 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:22.386387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a38dd-8430-4ec4-91e5-6e1ada078283 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:22.386873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a38dd-8430-4ec4-91e5-6e1ada078283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:22.406612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8e1a38dd-8430-4ec4-91e5-6e1ada078283 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:22.408136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8e1a38dd-8430-4ec4-91e5-6e1ada078283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:22.419477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:22.491241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 448/904] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:22.778689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a75010-73e5-487a-8f28-379bf521bc51 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:22.792308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:22.897261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a75010-73e5-487a-8f28-379bf521bc51 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:22.903167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d4b7-dd0a-44e3-be6f-9b7e696f2672 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:22.903705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d4b7-dd0a-44e3-be6f-9b7e696f2672 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:22.904138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210d4b7-dd0a-44e3-be6f-9b7e696f2672 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:22.906704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 449/905] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:22.912773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cd270-cbe1-4f37-bfaf-b25560ff6329 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:22.913078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cd270-cbe1-4f37-bfaf-b25560ff6329 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:22.913323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753cd270-cbe1-4f37-bfaf-b25560ff6329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:22.939781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:22.940148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-753cd270-cbe1-4f37-bfaf-b25560ff6329 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:22.941083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:22.941570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:22.942091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:22.942205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-753cd270-cbe1-4f37-bfaf-b25560ff6329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:22.942987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:22.944604 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:22.954470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:22.955568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 26 00:26:22.956446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:22.959086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 457/906] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:22.965146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:23.038391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 450/907] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:23.071853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:23.104979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780f01e-ee6a-431d-9e0c-87603244218f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:23.154103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527cb3ba-8407-40d4-8011-c9f957d58c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:23.155163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cb3ba-8407-40d4-8011-c9f957d58c42 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.155672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cb3ba-8407-40d4-8011-c9f957d58c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.156166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527cb3ba-8407-40d4-8011-c9f957d58c42 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.157009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cb3ba-8407-40d4-8011-c9f957d58c42 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:23.157517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cb3ba-8407-40d4-8011-c9f957d58c42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:23.159119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527cb3ba-8407-40d4-8011-c9f957d58c42 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:23.164821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 458/908] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:23.171007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cd270-cbe1-4f37-bfaf-b25560ff6329 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:23.173147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2dfd3-4ad4-4ddc-b52b-2b03fa9d715d None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.173647 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2dfd3-4ad4-4ddc-b52b-2b03fa9d715d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.174160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2dfd3-4ad4-4ddc-b52b-2b03fa9d715d None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.175969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 459/909] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:23.183656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c433ce8-386e-4b08-9aef-a238fed05c7b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.184240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c433ce8-386e-4b08-9aef-a238fed05c7b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.184711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c433ce8-386e-4b08-9aef-a238fed05c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.205737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5c433ce8-386e-4b08-9aef-a238fed05c7b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:23.208252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5c433ce8-386e-4b08-9aef-a238fed05c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:23.272427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:23.301984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 460/910] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:23.306832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753cd270-cbe1-4f37-bfaf-b25560ff6329 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:23.347165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:23.347786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.348075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.348329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.348988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:23.349293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:23.350756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:23.356795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 451/911] 10.222.0.88 () {56 vars in 1114 bytes} [Fri Aug 26 00:26:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:23.363585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c433ce8-386e-4b08-9aef-a238fed05c7b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:23.365930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:23.449591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:23.500128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18519384-c0c9-4cbf-b8c6-8e8f97005bb8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:23.507716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c433ce8-386e-4b08-9aef-a238fed05c7b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:23.548320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a204d5c-fadc-4ce8-a607-20115b75c5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:23.549089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a204d5c-fadc-4ce8-a607-20115b75c5c3 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.549267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a204d5c-fadc-4ce8-a607-20115b75c5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.549551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a204d5c-fadc-4ce8-a607-20115b75c5c3 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.550391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a204d5c-fadc-4ce8-a607-20115b75c5c3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:23.555893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a204d5c-fadc-4ce8-a607-20115b75c5c3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:23.579273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f393a5-c7d8-448c-adbc-7945fca8e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:23.580217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f393a5-c7d8-448c-adbc-7945fca8e6fe None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.580741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f393a5-c7d8-448c-adbc-7945fca8e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.581220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f393a5-c7d8-448c-adbc-7945fca8e6fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.582206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f393a5-c7d8-448c-adbc-7945fca8e6fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:23.583960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f393a5-c7d8-448c-adbc-7945fca8e6fe None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:23.590279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:23.590558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 452/912] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:26:23 2022] POST /identity/v3/services => generated 241 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:26:23.616073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a204d5c-fadc-4ce8-a607-20115b75c5c3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:23.618999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 461/913] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:26:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:23.774728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2000a-9eae-44f7-b64c-d2a856509a81 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.775020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2000a-9eae-44f7-b64c-d2a856509a81 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.775305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2000a-9eae-44f7-b64c-d2a856509a81 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.776193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a204d5c-fadc-4ce8-a607-20115b75c5c3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:23.777029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 462/914] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:23.783830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1d36e-d46b-408f-b756-093e3324f7c3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.784115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1d36e-d46b-408f-b756-093e3324f7c3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.784392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c1d36e-d46b-408f-b756-093e3324f7c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.809279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-61c1d36e-d46b-408f-b756-093e3324f7c3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:23.810530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-61c1d36e-d46b-408f-b756-093e3324f7c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:23.828161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:23.829116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:23.829604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:23.830663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:23.831377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:23.833400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:23.846494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:23.847476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:23.848325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 453/915] 10.222.0.88 () {56 vars in 1132 bytes} [Fri Aug 26 00:26:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:23.854111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:23.907139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 463/916] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:23.929326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:23.977069 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fc44c3-75ad-48b8-b7a6-26f3cafd19bd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:24.025008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:24.025630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:24.025943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:24.026228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:24.027008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:24.027317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:24.028709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:24.035047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 454/917] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:24.040440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1d36e-d46b-408f-b756-093e3324f7c3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:24.102226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:24.158264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c1d36e-d46b-408f-b756-093e3324f7c3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:24.187702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:24.197286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:24.197945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:24.198778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:24.199058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:24.199990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:24.200302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:24.201955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:24.213912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 464/918] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:24.215377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:24.330393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95694c29-7c0a-4769-a6a3-368b312821f3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:24.334382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c523f4d8-a605-481b-be59-52f8f6e190d9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:24.351636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:24.366387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:24.375962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:24.377064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:24.377856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:24.378515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:24.379540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] RBAC: Adding query filter params (interface=public, service_id=07272d56abeb493e9bba5253ee75ef9e, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:24.380062 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:24.381675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:24.386745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd82b45-d24e-49d7-b3c8-3b1046ce86d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:24.387475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd82b45-d24e-49d7-b3c8-3b1046ce86d0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:24.387910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd82b45-d24e-49d7-b3c8-3b1046ce86d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:24.388117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd82b45-d24e-49d7-b3c8-3b1046ce86d0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:24.388685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 465/919] 10.222.0.88 () {56 vars in 1251 bytes} [Fri Aug 26 00:26:24 2022] GET /identity/v3/endpoints?service_id=07272d56abeb493e9bba5253ee75ef9e&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:24.395067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:24.407417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd82b45-d24e-49d7-b3c8-3b1046ce86d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-bcd82b45-d24e-49d7-b3c8-3b1046ce86d0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:24.413782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:24.415356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:24.416641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 455/920] 10.222.0.88 () {56 vars in 1120 bytes} [Fri Aug 26 00:26:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:24.421871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd82b45-d24e-49d7-b3c8-3b1046ce86d0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:24.543144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fb7294-f66c-4968-878a-a771f6af50d6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:24.555408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd82b45-d24e-49d7-b3c8-3b1046ce86d0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:24.598219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0a809-d93a-4010-a793-30f032d910cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:24.599260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a809-d93a-4010-a793-30f032d910cb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:24.599733 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a809-d93a-4010-a793-30f032d910cb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:24.600204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0a809-d93a-4010-a793-30f032d910cb None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:24.600991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0a809-d93a-4010-a793-30f032d910cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:24.601112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:24.601705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:24.602085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:24.602434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:24.603297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f0a809-d93a-4010-a793-30f032d910cb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:24.603414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:24.603765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:24.605200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:24.612845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 466/921] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:26:24 2022] GET /identity/v3/services => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:26:24.621439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 456/922] 10.222.0.88 () {56 vars in 1115 bytes} [Fri Aug 26 00:26:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:24.631284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0a809-d93a-4010-a793-30f032d910cb None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:24.686983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:24.756588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f0a809-d93a-4010-a793-30f032d910cb None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:24.796719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:24.797393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:24.797675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:24.797972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:24.810532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:24.812581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:24.830285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:24.831381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:24.832264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:24.832264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:24.832264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:24.832264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 467/923] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:24.837452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:24.884051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:24.947385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed41f7-53b1-437e-a089-b48ebbe2b4b3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:24.983303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:24.983923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:24.984206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:24.984543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:24.985201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:24.985502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:24.986913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:24.999738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 457/924] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:25.005296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:25.117112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:25.125645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede50c48-0ef0-431f-89f3-3203d2a8a237 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:25.166226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:25.166771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.167054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.167334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.175840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:25.177322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:25.191782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:25.192779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:25.193714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 468/925] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:26:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:25.200710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:25.330607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbcbac0-af8b-4938-b2f7-1a52e5c53ed0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:25.333166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:25.381478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:25.382455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.382947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.383432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.384726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:25.385261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:25.387795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:25.417203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 458/926] 10.222.0.88 () {56 vars in 1149 bytes} [Fri Aug 26 00:26:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:25.423343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:25.550861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a13a-1312-4920-bf18-7e63fa3c32fc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:25.595159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1a50b-fe6b-4d36-a80d-74765ce05c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:25.595797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a50b-fe6b-4d36-a80d-74765ce05c3b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.596126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a50b-fe6b-4d36-a80d-74765ce05c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.596411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1a50b-fe6b-4d36-a80d-74765ce05c3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.608086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1a50b-fe6b-4d36-a80d-74765ce05c3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:25.609568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1a50b-fe6b-4d36-a80d-74765ce05c3b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-71a1a50b-fe6b-4d36-a80d-74765ce05c3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:25.624756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:25.625736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:25.626656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:25.626656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:25.626656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:25.626656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 469/927] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:25.633085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:25.704156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183687b-ea5d-4e97-a968-8f21a710279b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.704787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183687b-ea5d-4e97-a968-8f21a710279b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.705319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183687b-ea5d-4e97-a968-8f21a710279b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.707182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 470/928] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:25.712591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8053f-e815-4c26-843d-6e3ac6b3703e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.713136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8053f-e815-4c26-843d-6e3ac6b3703e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.713610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8053f-e815-4c26-843d-6e3ac6b3703e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.736921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0ae8053f-e815-4c26-843d-6e3ac6b3703e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:25.743375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdcaf7-5da1-487a-b345-ebc8717e6c29 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:25.743539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0ae8053f-e815-4c26-843d-6e3ac6b3703e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:25.749045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:25.788125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:25.789139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.789621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.790126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.791331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:25.792120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:25.794249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:25.815041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 459/929] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:25.816291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:25.840791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:25.847912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 471/930] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:25.860322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc380e-2cbf-4d89-9a93-9b2113084ffb None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.860664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc380e-2cbf-4d89-9a93-9b2113084ffb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.860880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc380e-2cbf-4d89-9a93-9b2113084ffb None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.862567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 472/931] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:25.868374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df317789-c11b-4e29-9c7b-3b8a64d7cea2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.868719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df317789-c11b-4e29-9c7b-3b8a64d7cea2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.869635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df317789-c11b-4e29-9c7b-3b8a64d7cea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.895362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-df317789-c11b-4e29-9c7b-3b8a64d7cea2 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:25.896842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-df317789-c11b-4e29-9c7b-3b8a64d7cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:25.945771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a695025-bc71-4d90-9411-a035cc1cf8eb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:25.986362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 473/932] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:25.989667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:25.990340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:25.990625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:25.990898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:25.998085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.000168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:26.011841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:26.012938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.014536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 460/933] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:26.019205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df317789-c11b-4e29-9c7b-3b8a64d7cea2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.094413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:26.134126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df317789-c11b-4e29-9c7b-3b8a64d7cea2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.135556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.178264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:26.178952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.179151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.179429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.180174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:26.180424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.181862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.195484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 474/934] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:26.201850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.247070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:26.275370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d884e4-3f06-4657-bb93-e778a754fe10 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.315808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2287a-e1f4-43a2-8057-5de5c719abf6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.324496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:26.325135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.325418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.325700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.326959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.328343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:26.337608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:26.338678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:26.339496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.344310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 461/935] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:26.344866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.347016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:26.358320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93477944-af5c-43f6-9884-84016c0353bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:26.359000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477944-af5c-43f6-9884-84016c0353bd None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.359287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477944-af5c-43f6-9884-84016c0353bd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.359563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93477944-af5c-43f6-9884-84016c0353bd None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/902b00eca0fa4008b98205dfc26f4a6e/roles/78c5de78f20944078beaf3ec85795d46` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.361736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93477944-af5c-43f6-9884-84016c0353bd None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=902b00eca0fa4008b98205dfc26f4a6e, role_id=78c5de78f20944078beaf3ec85795d46)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.363357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93477944-af5c-43f6-9884-84016c0353bd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.389921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 475/936] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:26:26 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/902b00eca0fa4008b98205dfc26f4a6e/roles/78c5de78f20944078beaf3ec85795d46 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:26:26.389921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93477944-af5c-43f6-9884-84016c0353bd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.482107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c1fa4-2933-47b9-8cbc-5c5d79213d08 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.507475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93477944-af5c-43f6-9884-84016c0353bd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.545829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:26.546903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.547361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.547791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.548612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.551402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.551553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:26.552018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.552197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.552563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.554189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:26.554189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.554367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING keystone.server.flask.common [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 26 00:26:26.555557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.564116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 476/937] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:26.571109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.577316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:26.582508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.sql.core [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:26:26.582508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 00:26:26.582508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [parameters: {'id': 'b9e929a9eebd416a941d4172f5c4ee63', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 00:26:26.582508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81540) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b9e929a9eebd416a941d4172f5c4ee63.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b9e929a9eebd416a941d4172f5c4ee63. Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:26:26.604251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result.read() Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 26 00:26:26.605249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application yield resource Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise self.value Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application session.commit() Aug 26 00:26:26.606336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:26:26.607433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:26:26.608816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result.read() Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:26:26.609723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [parameters: {'id': 'b9e929a9eebd416a941d4172f5c4ee63', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:26.611262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:26.612723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b9e929a9eebd416a941d4172f5c4ee63. Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.618327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 462/938] 10.222.0.88 () {60 vars in 1140 bytes} [Fri Aug 26 00:26:26 2022] POST /identity/v3/projects => generated 262 bytes in 267 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:26.620256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.673237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:26.731078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8466c4cf-d1f8-43c8-970d-e0314c1bbea8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.748892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30592288-ebd6-4610-9484-6600e9d71ab4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.771176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:26.772158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.772644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.773152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.774087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:26.774614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.776337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.784591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 477/939] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:26.789936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.801333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f613100-e5e6-4ae2-8ccf-1d47e50ca37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:26.802366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613100-e5e6-4ae2-8ccf-1d47e50ca37b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.803118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613100-e5e6-4ae2-8ccf-1d47e50ca37b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.803627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f613100-e5e6-4ae2-8ccf-1d47e50ca37b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.812182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f613100-e5e6-4ae2-8ccf-1d47e50ca37b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.814289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f613100-e5e6-4ae2-8ccf-1d47e50ca37b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5f613100-e5e6-4ae2-8ccf-1d47e50ca37b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:26.829153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:26.830317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:26.831400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:26.831400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:26.831400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:26.831400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:26.831400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:26.831400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:26.831400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:26.831400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:26.834046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 463/940] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:26.834046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed70f-13d8-46d6-abbb-b7147c51c1ca None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.834046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed70f-13d8-46d6-abbb-b7147c51c1ca None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.834312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bed70f-13d8-46d6-abbb-b7147c51c1ca None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.838801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 464/941] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:26.840281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed70f-13d8-46d6-abbb-b7147c51c1ca None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:26.917156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:26.917537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f71141-ee05-4e1e-831c-91a4580a2a41 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.937734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:26.968539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5c0bdb-8ebe-40f7-9151-f7d39ac8c15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:26.969157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c0bdb-8ebe-40f7-9151-f7d39ac8c15b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.969443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c0bdb-8ebe-40f7-9151-f7d39ac8c15b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.969726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5c0bdb-8ebe-40f7-9151-f7d39ac8c15b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.970462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c0bdb-8ebe-40f7-9151-f7d39ac8c15b None admin] RBAC: Adding query filter params (interface=public, service_id=dfdc8edb9742453d983245cf367f0222, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:26.970772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c0bdb-8ebe-40f7-9151-f7d39ac8c15b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:26.972160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5c0bdb-8ebe-40f7-9151-f7d39ac8c15b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:26.973214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bed70f-13d8-46d6-abbb-b7147c51c1ca None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:26.977859 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 478/942] 10.222.0.88 () {56 vars in 1251 bytes} [Fri Aug 26 00:26:26 2022] GET /identity/v3/endpoints?service_id=dfdc8edb9742453d983245cf367f0222&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:26.979132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b5bd-3834-47bd-8175-136855263ec6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:26.979418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b5bd-3834-47bd-8175-136855263ec6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:26.979694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b5bd-3834-47bd-8175-136855263ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:26.999836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0302b5bd-3834-47bd-8175-136855263ec6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:27.001500 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0302b5bd-3834-47bd-8175-136855263ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:27.012760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:27.013373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:27.014316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:27.014594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:27.015271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:27.015575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:27.017017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:27.038751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 465/943] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:27.038751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:27.111538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 479/944] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:27.193060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45307310-6bd5-4a17-91aa-a52a62dbf115 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:27.214295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:27.228935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfadd7-ce0e-429f-9b78-1b34d784bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:27.229554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfadd7-ce0e-429f-9b78-1b34d784bf01 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:27.229853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfadd7-ce0e-429f-9b78-1b34d784bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:27.230258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bfadd7-ce0e-429f-9b78-1b34d784bf01 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:27.230955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfadd7-ce0e-429f-9b78-1b34d784bf01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:27.233590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bfadd7-ce0e-429f-9b78-1b34d784bf01 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:27.240518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 466/945] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:26:27 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:26:27.403091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302b5bd-3834-47bd-8175-136855263ec6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:27.522113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302b5bd-3834-47bd-8175-136855263ec6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:27.542291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:27.571842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:27.572530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:27.572776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:27.573022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:27.573623 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:27.575128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:27.585407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:27.586443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:27.587334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 480/946] 10.222.0.88 () {56 vars in 1132 bytes} [Fri Aug 26 00:26:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:27.593828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfadd7-ce0e-429f-9b78-1b34d784bf01 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:27.710817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bfadd7-ce0e-429f-9b78-1b34d784bf01 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:27.749767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:27.750485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:27.750811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:27.751248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:27.751971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:27.752287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:27.753670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:27.759664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 467/947] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:27.765784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:27.887974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a374f-3132-4261-849e-54ed7228a149 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:27.925085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbb8af-3f26-46ee-8364-1acd35d35ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:27.926078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb8af-3f26-46ee-8364-1acd35d35ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:27.926544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb8af-3f26-46ee-8364-1acd35d35ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:27.927000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbb8af-3f26-46ee-8364-1acd35d35ce0 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:27.928082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbb8af-3f26-46ee-8364-1acd35d35ce0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:27.928679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbb8af-3f26-46ee-8364-1acd35d35ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:27.930366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dbb8af-3f26-46ee-8364-1acd35d35ce0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:27.936358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 481/948] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:27.942275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:28.004329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:28.061527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2424b-53b8-42d1-9741-098a516ee50a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:28.103066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96636add-3fbf-4450-ba3a-bca4030236d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:28.103875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96636add-3fbf-4450-ba3a-bca4030236d8 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:28.104226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96636add-3fbf-4450-ba3a-bca4030236d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:28.104599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96636add-3fbf-4450-ba3a-bca4030236d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:28.105334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96636add-3fbf-4450-ba3a-bca4030236d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:28.106906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96636add-3fbf-4450-ba3a-bca4030236d8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:28.137858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 468/949] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:26:27 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:26:28.659348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d56e0-fc6d-4011-8240-757e39ccbe58 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:28.659952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d56e0-fc6d-4011-8240-757e39ccbe58 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:28.659952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d56e0-fc6d-4011-8240-757e39ccbe58 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:28.661358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 482/950] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:28.667547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031c5bd-3434-48a8-a3cc-aa4445b63a2f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:28.668161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031c5bd-3434-48a8-a3cc-aa4445b63a2f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:28.668675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8031c5bd-3434-48a8-a3cc-aa4445b63a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:28.690270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8031c5bd-3434-48a8-a3cc-aa4445b63a2f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:28.692177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8031c5bd-3434-48a8-a3cc-aa4445b63a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:28.776202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 469/951] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:29.062143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d56e0-fc6d-4011-8240-757e39ccbe58 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:29.107469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:29.176394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d56e0-fc6d-4011-8240-757e39ccbe58 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:29.213534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea62cb7-907c-4d2c-afe0-9f7149c4ec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:29.214287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62cb7-907c-4d2c-afe0-9f7149c4ec7c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.214573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62cb7-907c-4d2c-afe0-9f7149c4ec7c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.214853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62cb7-907c-4d2c-afe0-9f7149c4ec7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.226766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea62cb7-907c-4d2c-afe0-9f7149c4ec7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fea62cb7-907c-4d2c-afe0-9f7149c4ec7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:29.231710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:29.233521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:29.234531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 483/952] 10.222.0.88 () {56 vars in 1120 bytes} [Fri Aug 26 00:26:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:29.242124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031c5bd-3434-48a8-a3cc-aa4445b63a2f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:29.260033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fcd8d-542a-45bb-b9a8-6ea7673596ee None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.260269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fcd8d-542a-45bb-b9a8-6ea7673596ee None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.260521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9fcd8d-542a-45bb-b9a8-6ea7673596ee None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.262126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 484/953] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:29.268082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a5ad-7921-45c4-a7a1-6ff6be0cc7f4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.268380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a5ad-7921-45c4-a7a1-6ff6be0cc7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.268633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627a5ad-7921-45c4-a7a1-6ff6be0cc7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.280785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:29.287819 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d627a5ad-7921-45c4-a7a1-6ff6be0cc7f4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:29.289032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d627a5ad-7921-45c4-a7a1-6ff6be0cc7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:29.362011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8031c5bd-3434-48a8-a3cc-aa4445b63a2f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:29.363037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 485/954] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:29.371294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fc64-fd2c-492c-94b7-2f9e72668fc3 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.371601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fc64-fd2c-492c-94b7-2f9e72668fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.373914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26fc64-fd2c-492c-94b7-2f9e72668fc3 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.378036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 486/955] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:29 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:29.379343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfaba-b729-4fff-9599-6ae99508b6cf None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.379559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfaba-b729-4fff-9599-6ae99508b6cf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.379833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719cfaba-b729-4fff-9599-6ae99508b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.398165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-719cfaba-b729-4fff-9599-6ae99508b6cf None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:29.399388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-719cfaba-b729-4fff-9599-6ae99508b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:29.404758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:29.405690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.406202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.406708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.407596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:29.408129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:29.409720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:29.419333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 470/956] 10.222.0.88 () {56 vars in 1115 bytes} [Fri Aug 26 00:26:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:29.424731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:29.426311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:29.485910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 487/957] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:29.542355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:29.544623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d41f1-4f1c-4e78-a174-018bc8af6902 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:29.591443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:29.592972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.593804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.594478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.607981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:29.609996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:29.627424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:29.628721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:29.630083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:29.630083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:29.630083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:29.631804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 471/958] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:29.638253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cfaba-b729-4fff-9599-6ae99508b6cf None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:29.643804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:29.760266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719cfaba-b729-4fff-9599-6ae99508b6cf None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:29.772329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a86b8-f1a5-4b78-9b1a-3e18dafd7a10 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:29.801402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:29.802556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.803210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.803340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.803980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:29.804292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:29.805674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:29.813992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:29.814616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:29.814903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:29.815471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:29.815825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:29.817252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:29.823057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 488/959] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:29.823057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:29.835489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.sql.core [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:26:29.835489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 00:26:29.835489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [parameters: {'user_id': 'f6aa16471fff448fb55c472797c76dfd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 00:26:29.835489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81540) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result.read() Aug 26 00:26:29.843411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:26:29.844386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application yield resource Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application next(self.gen) Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.session.rollback() Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.force_reraise() Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise self.value Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application session.commit() Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 26 00:26:29.845439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._prepare_impl() Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.session.flush() Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._flush(objects) Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application compat.raise_( Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application flush_context.execute() Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rec.execute(self) Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 26 00:26:29.847143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 26 00:26:29.848041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result = self._query(query) Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application conn.query(q) Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application result.read() Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 26 00:26:29.848900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f6aa16471fff448fb55c472797c76dfd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:29.849726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 26 00:26:29.850631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 26 00:26:29.851584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 26 00:26:29.851584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 26 00:26:29.851584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 26 00:26:29.851584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 26 00:26:29.851584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 26 00:26:29.851584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:29.851584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 472/960] 10.222.0.88 () {60 vars in 1131 bytes} [Fri Aug 26 00:26:29 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:29.851584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:29.856673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:29.862021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:29.960490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338dfd42-8d39-45b8-b800-84fbbbec6a3b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.000520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.001208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.001788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.002109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.002642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.004071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.007467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af775f30-068d-4e66-ad26-a613461eb97b None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:30.014972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:30.016458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:30.017451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 489/961] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:29 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:30.018473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:30.052707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.053629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.053941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.054221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.061864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.063536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:30.075857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:30.077460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:30.078510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 473/962] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:26:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:30.079174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:30.114690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:30.143228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44d9720-8b44-4c1a-ac53-eab2854c0cb4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.170713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:30.191391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.192040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.192323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.192600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.201723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.203221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.214611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed339b0-c1db-4eb6-8e5c-c83ae2bfefe1 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:30.215204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:30.216333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 490/963] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:30.217996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:30.257601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.258293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.258522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.258792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.259438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:30.259742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.261108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.270389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 474/964] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:30.271245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:30.337930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840eab68-5b23-4093-b767-77a5cabc7a8c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.374478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.375091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.375371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.375650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.376383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:30.376692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.378153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.384156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7777763e-dee6-45db-9f9f-6f920137ec27 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.394654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:30.399015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 491/965] 10.222.0.88 () {56 vars in 1149 bytes} [Fri Aug 26 00:26:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:30.399755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:30.420353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:30.427295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3221bd-3cf0-491c-a837-f5ce9680df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.428175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3221bd-3cf0-491c-a837-f5ce9680df3f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.428450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3221bd-3cf0-491c-a837-f5ce9680df3f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.428726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3221bd-3cf0-491c-a837-f5ce9680df3f None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.429437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3221bd-3cf0-491c-a837-f5ce9680df3f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:30.429739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3221bd-3cf0-491c-a837-f5ce9680df3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.431455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3221bd-3cf0-491c-a837-f5ce9680df3f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.471445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 475/966] 10.222.0.88 () {56 vars in 1101 bytes} [Fri Aug 26 00:26:30 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:30.472720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193c12-de0f-4678-8eec-014df3b22a63 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.473003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193c12-de0f-4678-8eec-014df3b22a63 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.473277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24193c12-de0f-4678-8eec-014df3b22a63 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.475789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 476/967] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:30.475789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24193c12-de0f-4678-8eec-014df3b22a63 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:30.516671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202a4937-55cd-4903-bdef-c790f49757d0 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.565050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c583c34-e48d-4790-897a-550b4b00d11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.565867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c583c34-e48d-4790-897a-550b4b00d11f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.566256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c583c34-e48d-4790-897a-550b4b00d11f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.566606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c583c34-e48d-4790-897a-550b4b00d11f None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.567340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c583c34-e48d-4790-897a-550b4b00d11f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:30.567726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c583c34-e48d-4790-897a-550b4b00d11f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.569705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c583c34-e48d-4790-897a-550b4b00d11f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.579614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 492/968] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:30.581090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5c57f-a6ab-441d-90f3-dc13492a7ed6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.581558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5c57f-a6ab-441d-90f3-dc13492a7ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.581997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b5c57f-a6ab-441d-90f3-dc13492a7ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.601556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-39b5c57f-a6ab-441d-90f3-dc13492a7ed6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:30.603338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-39b5c57f-a6ab-441d-90f3-dc13492a7ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:30.619883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24193c12-de0f-4678-8eec-014df3b22a63 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.665691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413833-46cb-487c-94d0-31c35102b9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.666850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413833-46cb-487c-94d0-31c35102b9cd None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.666850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413833-46cb-487c-94d0-31c35102b9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.667047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7413833-46cb-487c-94d0-31c35102b9cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.688589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:30.702561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 493/969] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:30.704082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5c57f-a6ab-441d-90f3-dc13492a7ed6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:30.743880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:30.766955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413833-46cb-487c-94d0-31c35102b9cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.768674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7413833-46cb-487c-94d0-31c35102b9cd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.841537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b5c57f-a6ab-441d-90f3-dc13492a7ed6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:30.883456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb55a9-b141-4b8d-8d75-23517ae8ea2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:30.884102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb55a9-b141-4b8d-8d75-23517ae8ea2a None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:30.884351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb55a9-b141-4b8d-8d75-23517ae8ea2a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:30.884627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb55a9-b141-4b8d-8d75-23517ae8ea2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:30.885289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb55a9-b141-4b8d-8d75-23517ae8ea2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:30.886730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb55a9-b141-4b8d-8d75-23517ae8ea2a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:30.898349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 477/970] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:30 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:26:30.899485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413833-46cb-487c-94d0-31c35102b9cd None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:30.915106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 494/971] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:26:30 2022] POST /identity/v3/endpoints => generated 349 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:30.989369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb55a9-b141-4b8d-8d75-23517ae8ea2a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:31.025106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:31.042550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7413833-46cb-487c-94d0-31c35102b9cd None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:31.055235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:31.093729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:31.094470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:31.094750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:31.095019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:31.108453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:31.110009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:31.121076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb55a9-b141-4b8d-8d75-23517ae8ea2a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:31.126886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:31.127850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:31.130777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:31.130777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:31.130777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:31.130777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 478/972] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:31.134607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:31.165490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:31.166172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:31.166457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:31.166737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:31.167347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:31.168740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:31.179921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:31.180959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:31.181783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 495/973] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:31.187850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:31.256980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2012797-fe69-4762-9be6-794ea4dadfdb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:31.296440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:31.297070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:31.297324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:31.297503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:31.298197 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:31.298503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:31.299886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:31.302569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:31.314113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cbc9f0-8ca2-423e-aacd-7ef564065211 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:31.314770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 479/974] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:31.320406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:31.335000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:31.358872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:31.359971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:31.360246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:31.360521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:31.361154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:31.361457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:31.362952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:31.368770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 496/975] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:31.375019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:31.441323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b1b250-1895-4fca-a76a-c6c484e3dabb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:31.480641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:31.481273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:31.481557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:31.481829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:31.490000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:31.491459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:31.498524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37357e-7bf7-47cf-88a3-d066033e7dc3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:31.504450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:31.505368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:31.506304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 480/976] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:31.513108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:31.539710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:31.540321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:31.540600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:31.540869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:31.541573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:31.541904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:31.543803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:31.549509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 497/977] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:31.594635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:31.655443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab731fc4-c07a-4890-913c-fbff95f09960 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:31.697338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf938e-8275-44b0-940f-a50a17135f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:31.698356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf938e-8275-44b0-940f-a50a17135f76 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:31.698356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf938e-8275-44b0-940f-a50a17135f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:31.698557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf938e-8275-44b0-940f-a50a17135f76 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:31.699208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf938e-8275-44b0-940f-a50a17135f76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:31.699515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf938e-8275-44b0-940f-a50a17135f76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:31.701524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf938e-8275-44b0-940f-a50a17135f76 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:31.715741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 481/978] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:31.722462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:31.770855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:31.836498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acaf47e-febd-4651-84b5-0797adaf7a9a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:31.873925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2442a8-f766-4773-86d9-3330aed377f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:31.874754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2442a8-f766-4773-86d9-3330aed377f6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:31.874914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2442a8-f766-4773-86d9-3330aed377f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:31.875219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2442a8-f766-4773-86d9-3330aed377f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:31.875965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2442a8-f766-4773-86d9-3330aed377f6 None admin] RBAC: Adding query filter params (role.id=78c5de78f20944078beaf3ec85795d46, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=902b00eca0fa4008b98205dfc26f4a6e) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:31.876278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2442a8-f766-4773-86d9-3330aed377f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:31.877737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2442a8-f766-4773-86d9-3330aed377f6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:31.889942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 498/979] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:31 2022] GET /identity/v3/role_assignments?user.id=902b00eca0fa4008b98205dfc26f4a6e&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=78c5de78f20944078beaf3ec85795d46 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:32.939435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54e98-36e6-40a5-b44e-1cce82f73177 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:32.940095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54e98-36e6-40a5-b44e-1cce82f73177 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:32.940095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c54e98-36e6-40a5-b44e-1cce82f73177 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:32.941391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 482/980] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:32.946514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b731-9a1d-4ead-ac89-08007d1ca631 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:32.946956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b731-9a1d-4ead-ac89-08007d1ca631 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:32.947136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8b731-9a1d-4ead-ac89-08007d1ca631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:32.965832 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6bf8b731-9a1d-4ead-ac89-08007d1ca631 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:32.967628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6bf8b731-9a1d-4ead-ac89-08007d1ca631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:33.040919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 499/981] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:33.319063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c54e98-36e6-40a5-b44e-1cce82f73177 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:33.423598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c54e98-36e6-40a5-b44e-1cce82f73177 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:33.441181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:33.460992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339f6ec-b523-4c14-9e0e-32e0b8a6eed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:33.461640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339f6ec-b523-4c14-9e0e-32e0b8a6eed3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:33.461946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339f6ec-b523-4c14-9e0e-32e0b8a6eed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:33.462277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339f6ec-b523-4c14-9e0e-32e0b8a6eed3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:33.462805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339f6ec-b523-4c14-9e0e-32e0b8a6eed3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:33.464170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339f6ec-b523-4c14-9e0e-32e0b8a6eed3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b339f6ec-b523-4c14-9e0e-32e0b8a6eed3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:33.473026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:33.473993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:33.474830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:33.476170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 483/982] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:33.480087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b731-9a1d-4ead-ac89-08007d1ca631 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:33.495768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea605-2f13-48ba-be82-8838492fe548 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:33.496055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea605-2f13-48ba-be82-8838492fe548 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:33.496335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ea605-2f13-48ba-be82-8838492fe548 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:33.498285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 484/983] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:33.503372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d73be-5edb-4300-877d-ac96c20ad342 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:33.503656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d73be-5edb-4300-877d-ac96c20ad342 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:33.503935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d73be-5edb-4300-877d-ac96c20ad342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:33.520723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:33.523214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7e3d73be-5edb-4300-877d-ac96c20ad342 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:33.524901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7e3d73be-5edb-4300-877d-ac96c20ad342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:33.598018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8b731-9a1d-4ead-ac89-08007d1ca631 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:33.607993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 485/984] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:33.635418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:33.636028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:33.636315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:33.636594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:33.637223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:33.637529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:33.639211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:33.648937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 500/985] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:33.650059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d73be-5edb-4300-877d-ac96c20ad342 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:33.752856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d73be-5edb-4300-877d-ac96c20ad342 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:33.764536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:33.789236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db81a2d-78eb-43f6-ade4-b02520fb0594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:33.789848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81a2d-78eb-43f6-ade4-b02520fb0594 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:33.790157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81a2d-78eb-43f6-ade4-b02520fb0594 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:33.790428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db81a2d-78eb-43f6-ade4-b02520fb0594 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:33.791132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db81a2d-78eb-43f6-ade4-b02520fb0594 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:33.791475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db81a2d-78eb-43f6-ade4-b02520fb0594 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:33.792908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db81a2d-78eb-43f6-ade4-b02520fb0594 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:33.803311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 486/986] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:33.804430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:33.839199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a094b-cb6b-43ec-adc7-4fd4a552ae46 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:33.839407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a094b-cb6b-43ec-adc7-4fd4a552ae46 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:33.839653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a094b-cb6b-43ec-adc7-4fd4a552ae46 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:33.840980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 487/987] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:33.846419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab25a27-fc0f-4a5b-8308-77b7a1fbc4ad None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:33.846708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab25a27-fc0f-4a5b-8308-77b7a1fbc4ad None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:33.846985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab25a27-fc0f-4a5b-8308-77b7a1fbc4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:33.866029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9ab25a27-fc0f-4a5b-8308-77b7a1fbc4ad None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:33.867239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9ab25a27-fc0f-4a5b-8308-77b7a1fbc4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:33.907641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:33.910653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2715f4-7e0b-4573-a351-4d725871302f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:33.936414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 488/988] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:33.937235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab25a27-fc0f-4a5b-8308-77b7a1fbc4ad None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:33.949007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:33.949634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:33.949940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:33.950232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:33.951434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] RBAC: Adding query filter params (interface=admin, service_id=dfdc8edb9742453d983245cf367f0222, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:33.952018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:33.953495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:33.963085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 501/989] 10.222.0.88 () {56 vars in 1249 bytes} [Fri Aug 26 00:26:33 2022] GET /identity/v3/endpoints?service_id=dfdc8edb9742453d983245cf367f0222&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:33.964128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:34.053440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab25a27-fc0f-4a5b-8308-77b7a1fbc4ad None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:34.057397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:34.072029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45eb58-f3ed-4389-b34c-db6524fb34bd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:34.095010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c13757-adbd-4fa2-80c5-ed717829b630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:34.095553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c13757-adbd-4fa2-80c5-ed717829b630 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:34.095819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c13757-adbd-4fa2-80c5-ed717829b630 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:34.096093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c13757-adbd-4fa2-80c5-ed717829b630 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:34.096845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c13757-adbd-4fa2-80c5-ed717829b630 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:34.098382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c13757-adbd-4fa2-80c5-ed717829b630 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:34.108313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577e58-687c-435b-8fee-656959e6ff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:34.108922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577e58-687c-435b-8fee-656959e6ff40 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:34.109281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577e58-687c-435b-8fee-656959e6ff40 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:34.109516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577e58-687c-435b-8fee-656959e6ff40 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:34.110218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577e58-687c-435b-8fee-656959e6ff40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:34.111587 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577e58-687c-435b-8fee-656959e6ff40 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:34.122254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 489/990] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:26:33 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:34.130122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 502/991] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:26:33 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:26:34.212587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c13757-adbd-4fa2-80c5-ed717829b630 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:34.334777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c13757-adbd-4fa2-80c5-ed717829b630 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:34.370610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:34.371175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:34.371461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:34.371738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] PATH_INFO: `/v3/services/image` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:34.372326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:34.374377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:34.383375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:34.384395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:34.385236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 490/992] 10.222.0.88 () {56 vars in 1105 bytes} [Fri Aug 26 00:26:34 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:34.391045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577e58-687c-435b-8fee-656959e6ff40 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:34.419251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:34.494041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577e58-687c-435b-8fee-656959e6ff40 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:34.529400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85166ac0-679b-43cb-bba3-c68ca6edec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:34.530034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85166ac0-679b-43cb-bba3-c68ca6edec52 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:34.530319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85166ac0-679b-43cb-bba3-c68ca6edec52 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:34.530593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85166ac0-679b-43cb-bba3-c68ca6edec52 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:34.531222 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85166ac0-679b-43cb-bba3-c68ca6edec52 None admin] RBAC: Adding query filter params (name=image) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:34.531528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85166ac0-679b-43cb-bba3-c68ca6edec52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:34.532903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85166ac0-679b-43cb-bba3-c68ca6edec52 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:34.538036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 503/993] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:34.543492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:34.578500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:34.658997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40d9e9-93ae-47f7-9b96-4ead9b4bf8bb None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:34.694374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2e9b4a-81b4-44b5-8d36-d0275b329f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:34.694981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9b4a-81b4-44b5-8d36-d0275b329f8d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:34.695264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9b4a-81b4-44b5-8d36-d0275b329f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:34.695535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2e9b4a-81b4-44b5-8d36-d0275b329f8d None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:34.696352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9b4a-81b4-44b5-8d36-d0275b329f8d None admin] RBAC: Adding query filter params (type=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:34.696656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9b4a-81b4-44b5-8d36-d0275b329f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:34.698040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2e9b4a-81b4-44b5-8d36-d0275b329f8d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:34.702700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 491/994] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:36.082894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc802b5-8b4e-4f21-be48-b6e1c5f9a3af None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.083458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc802b5-8b4e-4f21-be48-b6e1c5f9a3af None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.083458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc802b5-8b4e-4f21-be48-b6e1c5f9a3af None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.084912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 504/995] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:36.090257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f3f1-005f-48d5-a985-57fc69b59578 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.090686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f3f1-005f-48d5-a985-57fc69b59578 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.090852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29f3f1-005f-48d5-a985-57fc69b59578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.109961 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3a29f3f1-005f-48d5-a985-57fc69b59578 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:36.110248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8f3ac-2b94-43d6-8f49-4707b14ffd2b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.110447 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8f3ac-2b94-43d6-8f49-4707b14ffd2b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.110729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8f3ac-2b94-43d6-8f49-4707b14ffd2b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.111173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3a29f3f1-005f-48d5-a985-57fc69b59578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:36.112167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 505/996] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:36.116854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012e350-5f2e-4bc6-b2b1-8d1899a1c06f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.117141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012e350-5f2e-4bc6-b2b1-8d1899a1c06f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.117426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012e350-5f2e-4bc6-b2b1-8d1899a1c06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.135265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1012e350-5f2e-4bc6-b2b1-8d1899a1c06f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:36.136455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1012e350-5f2e-4bc6-b2b1-8d1899a1c06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:36.186842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 492/997] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:36.211013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 506/998] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:36.459140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29f3f1-005f-48d5-a985-57fc69b59578 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:36.478662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:36.480492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012e350-5f2e-4bc6-b2b1-8d1899a1c06f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:36.507618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:36.579752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29f3f1-005f-48d5-a985-57fc69b59578 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:36.600468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1012e350-5f2e-4bc6-b2b1-8d1899a1c06f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:36.617902 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:36.618589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.618875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.619168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.619759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:36.621143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:36.631116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:36.632162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:36.632990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 493/999] 10.222.0.88 () {56 vars in 1126 bytes} [Fri Aug 26 00:26:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:36.639055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:36.641841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29800e50-61e9-4ae3-9402-abfc5f90126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:36.642505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29800e50-61e9-4ae3-9402-abfc5f90126f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.642788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29800e50-61e9-4ae3-9402-abfc5f90126f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.643060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29800e50-61e9-4ae3-9402-abfc5f90126f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.643644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29800e50-61e9-4ae3-9402-abfc5f90126f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:36.645019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29800e50-61e9-4ae3-9402-abfc5f90126f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-29800e50-61e9-4ae3-9402-abfc5f90126f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:36.654095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:36.655080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:36.656753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 507/1000] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:36.657739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc239-11fe-4894-a30a-9bbcbc9baf93 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.657739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc239-11fe-4894-a30a-9bbcbc9baf93 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.658013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afc239-11fe-4894-a30a-9bbcbc9baf93 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.659384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 508/1001] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:36.660603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc239-11fe-4894-a30a-9bbcbc9baf93 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:36.730476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:36.748880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:36.754204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce937df2-5495-494f-aa95-78e01173c6bf None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:36.765016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afc239-11fe-4894-a30a-9bbcbc9baf93 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:36.789224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd28bdd-5c84-4879-a37c-2c01ef7a7726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:36.789837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd28bdd-5c84-4879-a37c-2c01ef7a7726 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.790243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd28bdd-5c84-4879-a37c-2c01ef7a7726 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.790529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd28bdd-5c84-4879-a37c-2c01ef7a7726 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.791170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd28bdd-5c84-4879-a37c-2c01ef7a7726 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:36.791481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd28bdd-5c84-4879-a37c-2c01ef7a7726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:36.793004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd28bdd-5c84-4879-a37c-2c01ef7a7726 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:36.799228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 494/1002] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:36.800521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6d944-be5c-4487-bbdb-fa85f76a770a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.800745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:36.800863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6d944-be5c-4487-bbdb-fa85f76a770a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.801137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6d944-be5c-4487-bbdb-fa85f76a770a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.801364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.801631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.801913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.802799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:36.803099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:36.804461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:36.813006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 509/1003] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:36.813006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:36.820945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3ee6d944-be5c-4487-bbdb-fa85f76a770a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:36.822190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ee6d944-be5c-4487-bbdb-fa85f76a770a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:36.891372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 495/1004] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:36.892212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6d944-be5c-4487-bbdb-fa85f76a770a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:36.912936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c885f8-cdb1-4dcf-9763-df846e228518 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:36.950609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:36.951263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:36.952370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:36.952652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:36.953320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:36.953684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:36.955124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:36.965419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 510/1005] 10.222.0.88 () {56 vars in 1122 bytes} [Fri Aug 26 00:26:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:36.966394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:36.985911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:36.989472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:37.018865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6d944-be5c-4487-bbdb-fa85f76a770a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:37.058679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:37.059274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:37.059551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:37.059821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:37.060653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:37.060963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:37.062382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:37.072630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 496/1006] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:37.073566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:37.086715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1a0391-a595-444b-b8d8-ee14ea23aa6b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:37.125089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a6d5a-d988-4594-a4df-8cd1f2f57b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:37.126005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a6d5a-d988-4594-a4df-8cd1f2f57b6f None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:37.126462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a6d5a-d988-4594-a4df-8cd1f2f57b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:37.126882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047a6d5a-d988-4594-a4df-8cd1f2f57b6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:37.127697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a6d5a-d988-4594-a4df-8cd1f2f57b6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:37.129209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047a6d5a-d988-4594-a4df-8cd1f2f57b6f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:37.147043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 511/1007] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:26:36 2022] POST /identity/v3/endpoints => generated 325 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:26:37.162154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a6d5a-d988-4594-a4df-8cd1f2f57b6f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:37.193642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd8738-1e5e-40e7-977c-ecae1a9dd501 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:37.239634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:37.240162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:37.240444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:37.240770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:37.241425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] RBAC: Adding query filter params (interface=public, service_id=6611c8a93d194fe9bb023f7129e323e6, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:37.241731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:37.243228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:37.245908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:37.255115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 497/1008] 10.222.0.88 () {56 vars in 1251 bytes} [Fri Aug 26 00:26:37 2022] GET /identity/v3/endpoints?service_id=6611c8a93d194fe9bb023f7129e323e6&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:37.256094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:37.258164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:37.293905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047a6d5a-d988-4594-a4df-8cd1f2f57b6f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:37.341209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925cc86-84b8-478c-a016-2ada4803a6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:37.342109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cc86-84b8-478c-a016-2ada4803a6fc None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:37.342400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cc86-84b8-478c-a016-2ada4803a6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:37.342678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925cc86-84b8-478c-a016-2ada4803a6fc None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:37.343414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925cc86-84b8-478c-a016-2ada4803a6fc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:37.344817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925cc86-84b8-478c-a016-2ada4803a6fc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:37.361081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 512/1009] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:26:37 2022] POST /identity/v3/services => generated 242 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:26:37.374972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79053c8-6ec4-4623-b8da-0e15bca755a4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:37.421391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5403e5-27d7-49e9-a4b9-a5d04dd3c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:37.422041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5403e5-27d7-49e9-a4b9-a5d04dd3c494 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:37.422327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5403e5-27d7-49e9-a4b9-a5d04dd3c494 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:37.422601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5403e5-27d7-49e9-a4b9-a5d04dd3c494 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:37.423222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5403e5-27d7-49e9-a4b9-a5d04dd3c494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:37.424639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5403e5-27d7-49e9-a4b9-a5d04dd3c494 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:37.432539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 498/1010] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:26:37 2022] GET /identity/v3/services => generated 1957 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:26:39.121337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf072c0-e639-475d-9aad-5cf956ee53bf None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.121869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf072c0-e639-475d-9aad-5cf956ee53bf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.121869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf072c0-e639-475d-9aad-5cf956ee53bf None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.123570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 513/1011] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:39.129096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67759a9-b714-4bba-9307-71c7a86270da None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.129548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67759a9-b714-4bba-9307-71c7a86270da None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.129727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67759a9-b714-4bba-9307-71c7a86270da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.148909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c67759a9-b714-4bba-9307-71c7a86270da None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:39.150140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c67759a9-b714-4bba-9307-71c7a86270da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:39.211788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:39.224488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 499/1012] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:39.324552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c2e2-2f83-4cfe-b2be-6b45a66de859 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.325183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c2e2-2f83-4cfe-b2be-6b45a66de859 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.326205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732c2e2-2f83-4cfe-b2be-6b45a66de859 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.328259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 514/1013] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:39.333448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6b25-3d5b-424f-971a-80143d41297e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.333740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6b25-3d5b-424f-971a-80143d41297e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.334050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e6b25-3d5b-424f-971a-80143d41297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.348499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77d35-8e4a-422d-8d9b-27018f964ea8 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.348703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77d35-8e4a-422d-8d9b-27018f964ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.348919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c77d35-8e4a-422d-8d9b-27018f964ea8 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.350351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 515/1014] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:39.354791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a33e6b25-3d5b-424f-971a-80143d41297e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:39.354907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc58db0-cfa3-43c2-aecd-7dc5baed76df None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.355134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc58db0-cfa3-43c2-aecd-7dc5baed76df None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.355412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc58db0-cfa3-43c2-aecd-7dc5baed76df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.355988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a33e6b25-3d5b-424f-971a-80143d41297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:39.376628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4cc58db0-cfa3-43c2-aecd-7dc5baed76df None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:39.377749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4cc58db0-cfa3-43c2-aecd-7dc5baed76df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:39.432487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 500/1015] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:39.450284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 516/1016] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:39 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:39.509626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e6b25-3d5b-424f-971a-80143d41297e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:39.619881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e6b25-3d5b-424f-971a-80143d41297e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:39.641951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:39.657996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd685b83-e2ce-4bd1-a4f2-07ac88a8d1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:39.658631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685b83-e2ce-4bd1-a4f2-07ac88a8d1db None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.658921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685b83-e2ce-4bd1-a4f2-07ac88a8d1db None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.659195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd685b83-e2ce-4bd1-a4f2-07ac88a8d1db None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.660291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd685b83-e2ce-4bd1-a4f2-07ac88a8d1db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:39.661714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd685b83-e2ce-4bd1-a4f2-07ac88a8d1db None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:39.665923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 501/1017] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:39.669083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc58db0-cfa3-43c2-aecd-7dc5baed76df None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:39.709396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd685b83-e2ce-4bd1-a4f2-07ac88a8d1db None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:39.737444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:39.776358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc58db0-cfa3-43c2-aecd-7dc5baed76df None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:39.811894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0f70-b782-45ba-9abc-15e3b78ba394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:39.812505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0f70-b782-45ba-9abc-15e3b78ba394 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.812791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0f70-b782-45ba-9abc-15e3b78ba394 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.813161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf0f70-b782-45ba-9abc-15e3b78ba394 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.813252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd685b83-e2ce-4bd1-a4f2-07ac88a8d1db None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:39.813820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf0f70-b782-45ba-9abc-15e3b78ba394 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:39.815295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bf0f70-b782-45ba-9abc-15e3b78ba394 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:39.845933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 517/1018] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:26:39 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:39.845933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0f70-b782-45ba-9abc-15e3b78ba394 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:39.852376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:39.853085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:39.853373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:39.853648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] PATH_INFO: `/v3/services/image` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:39.854435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:39.855914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:39.866384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:39.867566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:39.871041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 502/1019] 10.222.0.88 () {56 vars in 1105 bytes} [Fri Aug 26 00:26:39 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:39.874113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:39.936334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:39.961240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf0f70-b782-45ba-9abc-15e3b78ba394 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:39.979777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:39.999604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68932e15-fa61-4f54-8ed3-e97bebca0f56 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:40.014464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:40.015223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:40.015507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:40.015782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:40.016390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:40.017782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:40.029404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:40.030552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:40.031434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 518/1020] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:40.037355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:40.046637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:40.047267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:40.047551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:40.047825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:40.048819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:40.048819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:40.050190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:40.055772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 503/1021] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:40.063011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:40.147009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdd4d2-0b2c-4e82-8060-7f6565e7f170 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:40.172242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ef3d2-eadc-43da-b44e-08844985b0e0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:40.183477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:40.184185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:40.184555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:40.185418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:40.186332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:40.186771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:40.188195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:40.190914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:40.197945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 519/1022] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:40.198908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:40.215306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:40.216195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:40.216195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:40.216195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:40.217844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] RBAC: Adding query filter params (type=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:40.217844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:40.218679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:40.229581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 504/1023] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:40.230682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:40.252919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:40.313898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11961697-cdad-4262-9536-a0cca978c6e2 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:40.344321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412373f-98d3-4193-8da7-65c094f8b22a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:40.351778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:40.352198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:40.352663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:40.353007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:40.353701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:40.354103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:40.355662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:40.365554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 520/1024] 10.222.0.88 () {56 vars in 1112 bytes} [Fri Aug 26 00:26:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:40.366600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:40.384649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:40.385260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:40.385547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:40.385821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:40.386998 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] RBAC: Adding query filter params (interface=public, service_id=6eff99531147459bb7d1e3dd9c9c2154, region_id=RegionOne) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:40.387310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:40.389443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:40.395090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 505/1025] 10.222.0.88 () {56 vars in 1251 bytes} [Fri Aug 26 00:26:40 2022] GET /identity/v3/endpoints?service_id=6eff99531147459bb7d1e3dd9c9c2154&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:40.400458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:40.448403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:40.480968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c454ff-52d5-4e17-add5-7986826d11c9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:40.492560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:40.511496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe38b5-a06c-4947-8864-95a6d9ce6749 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:40.519439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7bf03b-cc51-45a0-8fa5-ef7e0de52acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:40.520208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bf03b-cc51-45a0-8fa5-ef7e0de52acb None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:40.520572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bf03b-cc51-45a0-8fa5-ef7e0de52acb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:40.520947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7bf03b-cc51-45a0-8fa5-ef7e0de52acb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:40.521724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bf03b-cc51-45a0-8fa5-ef7e0de52acb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:40.523272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7bf03b-cc51-45a0-8fa5-ef7e0de52acb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:40.547160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 521/1026] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:26:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:26:40.567607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9842576c-fc5b-44e9-b59e-835b17e5a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:40.568233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842576c-fc5b-44e9-b59e-835b17e5a601 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:40.568514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842576c-fc5b-44e9-b59e-835b17e5a601 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:40.568808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9842576c-fc5b-44e9-b59e-835b17e5a601 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:40.569432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842576c-fc5b-44e9-b59e-835b17e5a601 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:40.573255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9842576c-fc5b-44e9-b59e-835b17e5a601 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:40.590008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 506/1027] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:26:40 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:26:42.022650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41586b-6cee-481f-9764-d94418ee4ad2 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:42.023179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41586b-6cee-481f-9764-d94418ee4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:42.023480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41586b-6cee-481f-9764-d94418ee4ad2 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:42.024707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 522/1028] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:42.030633 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595603-1365-4594-a494-d524994822db None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:42.031034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595603-1365-4594-a494-d524994822db None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:42.031199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9595603-1365-4594-a494-d524994822db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:42.050474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b9595603-1365-4594-a494-d524994822db None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:42.051671 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b9595603-1365-4594-a494-d524994822db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:42.125362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 507/1029] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:42.399967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41586b-6cee-481f-9764-d94418ee4ad2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:42.506886 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41586b-6cee-481f-9764-d94418ee4ad2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:42.542465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f77d92-91c8-433f-b6a4-94c4f4b55134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:42.543103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77d92-91c8-433f-b6a4-94c4f4b55134 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:42.543386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77d92-91c8-433f-b6a4-94c4f4b55134 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:42.543663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f77d92-91c8-433f-b6a4-94c4f4b55134 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:42.545511 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f77d92-91c8-433f-b6a4-94c4f4b55134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:42.547000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f77d92-91c8-433f-b6a4-94c4f4b55134 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:42.548737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 523/1030] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:42.558908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595603-1365-4594-a494-d524994822db None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:42.566451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6d868-14a7-47c3-b5b5-caef09603130 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:42.566771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6d868-14a7-47c3-b5b5-caef09603130 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:42.567052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a6d868-14a7-47c3-b5b5-caef09603130 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:42.568363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 524/1031] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:42.573655 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f4fb-ba42-4ded-9120-8f5640bfe83c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:42.573986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f4fb-ba42-4ded-9120-8f5640bfe83c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:42.574278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda6f4fb-ba42-4ded-9120-8f5640bfe83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:42.593787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cda6f4fb-ba42-4ded-9120-8f5640bfe83c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:42.595078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cda6f4fb-ba42-4ded-9120-8f5640bfe83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:42.600544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:42.624742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:42.671608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 525/1032] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:42.672797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35a3c9-6dc4-442b-a0a3-3768ec6660e0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:42.672921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9595603-1365-4594-a494-d524994822db None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:42.673085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35a3c9-6dc4-442b-a0a3-3768ec6660e0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:42.673361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35a3c9-6dc4-442b-a0a3-3768ec6660e0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:42.674765 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 526/1033] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:42.680055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f117-5089-4516-92d8-a3150226bb94 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:42.680343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f117-5089-4516-92d8-a3150226bb94 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:42.680623 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8f117-5089-4516-92d8-a3150226bb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:42.699289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8ce8f117-5089-4516-92d8-a3150226bb94 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:42.701101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8ce8f117-5089-4516-92d8-a3150226bb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:42.709490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7e8ba-6e32-4d7a-ae4b-2c05061f11a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:42.710131 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e8ba-6e32-4d7a-ae4b-2c05061f11a2 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:42.710410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e8ba-6e32-4d7a-ae4b-2c05061f11a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:42.710681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c7e8ba-6e32-4d7a-ae4b-2c05061f11a2 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:42.711563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7e8ba-6e32-4d7a-ae4b-2c05061f11a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:42.712979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c7e8ba-6e32-4d7a-ae4b-2c05061f11a2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:42.745917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 508/1034] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:26:42 2022] POST /identity/v3/users => generated 285 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:26:42.783373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 527/1035] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:42 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:42.944107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7e8ba-6e32-4d7a-ae4b-2c05061f11a2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.038596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:43.048949 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c7e8ba-6e32-4d7a-ae4b-2c05061f11a2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.055333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8f117-5089-4516-92d8-a3150226bb94 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.085758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.086524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.086810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.087183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.087666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:43.089047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:43.099622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:43.100657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:43.103305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 509/1036] 10.222.0.88 () {56 vars in 1105 bytes} [Fri Aug 26 00:26:42 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:43.107369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.155511 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:43.164993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8f117-5089-4516-92d8-a3150226bb94 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.201564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb837ce-109e-40c1-95bc-dd40a97bf3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.202151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb837ce-109e-40c1-95bc-dd40a97bf3ab None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.202454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb837ce-109e-40c1-95bc-dd40a97bf3ab None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.202732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb837ce-109e-40c1-95bc-dd40a97bf3ab None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.214115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb837ce-109e-40c1-95bc-dd40a97bf3ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:43.218645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f41e0b-3ce0-435a-86ca-1330ae27aef0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-bdb837ce-109e-40c1-95bc-dd40a97bf3ab None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:43.218898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:43.219800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:43.220878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 528/1037] 10.222.0.88 () {56 vars in 1120 bytes} [Fri Aug 26 00:26:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:43.225805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb837ce-109e-40c1-95bc-dd40a97bf3ab None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.258525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.259132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.259415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.259687 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.260377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] RBAC: Adding query filter params (name=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:43.260678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:43.262258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:43.273111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 510/1038] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:43.276231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.297613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:43.336215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb837ce-109e-40c1-95bc-dd40a97bf3ab None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.373584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.374224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.374503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.374774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.375438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:43.375741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:43.377143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:43.385911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 529/1039] 10.222.0.88 () {56 vars in 1115 bytes} [Fri Aug 26 00:26:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:43.389610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56071c06-bd66-49bf-82c2-c3db24bd6245 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.391479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.409163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:43.431666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.432285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.432572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.432851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.433492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] RBAC: Adding query filter params (type=image) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:43.433801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:43.435886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:43.445506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 511/1040] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:43.446894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.505131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609cfd34-2d8f-4ed5-916d-734e7522702a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.538755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27091-6644-4578-94c0-52357703036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.539376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27091-6644-4578-94c0-52357703036c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.539656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27091-6644-4578-94c0-52357703036c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.539932 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a27091-6644-4578-94c0-52357703036c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.540862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:43.553192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a27091-6644-4578-94c0-52357703036c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:43.554814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a27091-6644-4578-94c0-52357703036c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:43.566679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c002d91-8448-4d33-b8d1-6323c6d0b573 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-35a27091-6644-4578-94c0-52357703036c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:43.576802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:43.578014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:43.579110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:43.579110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:43.579110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:43.579110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 530/1041] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:43.579110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27091-6644-4578-94c0-52357703036c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.611041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a87872-1ad9-4252-ad81-259348b053d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.611742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a87872-1ad9-4252-ad81-259348b053d2 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.612089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a87872-1ad9-4252-ad81-259348b053d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.612443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a87872-1ad9-4252-ad81-259348b053d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.613164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a87872-1ad9-4252-ad81-259348b053d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:43.614559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a87872-1ad9-4252-ad81-259348b053d2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:43.642074 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 512/1042] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:26:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:26:43.661053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:43.703956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a27091-6644-4578-94c0-52357703036c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.747662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.748463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.748744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.749017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.749669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:43.750003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:43.751423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:43.770061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 531/1043] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:43.771264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a87872-1ad9-4252-ad81-259348b053d2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:43.881773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a87872-1ad9-4252-ad81-259348b053d2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:43.917580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:43.918521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:43.919606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:43.920065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:43.928908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:43.930632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:43.932476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:43.945156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:43.946241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:43.947184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 513/1044] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:26:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:43.953207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:44.058918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145324c-6343-4e71-8b53-57c6a0735d39 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:44.082771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:44.096023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:44.096631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:44.096909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:44.097182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:44.097943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:44.098255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:44.099692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:44.119853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 532/1045] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:26:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:44.126130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:44.228936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e66bd2-937c-44b9-9ba6-60b9a0aba7ba None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:44.266643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df27a0-7e2b-464c-b156-035c1df1f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:44.266643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df27a0-7e2b-464c-b156-035c1df1f535 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:44.267124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df27a0-7e2b-464c-b156-035c1df1f535 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:44.267124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df27a0-7e2b-464c-b156-035c1df1f535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:44.335451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:44.340476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df27a0-7e2b-464c-b156-035c1df1f535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:44.342296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df27a0-7e2b-464c-b156-035c1df1f535 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:44.442941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 514/1046] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:26:44.448429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:44.550085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1a74e4-8c94-4c4c-ae65-ea006d36b09c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:44.589084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1a948-0df1-4041-94cb-96310c22bdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:44.589655 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1a948-0df1-4041-94cb-96310c22bdbd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:44.589969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1a948-0df1-4041-94cb-96310c22bdbd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:44.590252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1a948-0df1-4041-94cb-96310c22bdbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:44.600911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1a948-0df1-4041-94cb-96310c22bdbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:44.602403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1a948-0df1-4041-94cb-96310c22bdbd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-92a1a948-0df1-4041-94cb-96310c22bdbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:44.618439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:44.619414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:44.625740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:44.625740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:44.625740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:44.625740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 533/1047] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:44.626393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df27a0-7e2b-464c-b156-035c1df1f535 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:44.725488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:44.730469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df27a0-7e2b-464c-b156-035c1df1f535 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:44.767663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef73fe-fc55-45c0-83f6-bc16cdf64b60 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:44.768139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef73fe-fc55-45c0-83f6-bc16cdf64b60 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:44.768520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef73fe-fc55-45c0-83f6-bc16cdf64b60 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:44.770087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 534/1048] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:44.770217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:44.770704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:44.770991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:44.771271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:44.771931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:44.772240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:44.773614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:44.776548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eb83f-865a-4559-95dc-976eaa997573 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:44.777026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eb83f-865a-4559-95dc-976eaa997573 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:44.777480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193eb83f-865a-4559-95dc-976eaa997573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:44.786256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 515/1049] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:44.792270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:44.797641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-193eb83f-865a-4559-95dc-976eaa997573 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:44.798879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-193eb83f-865a-4559-95dc-976eaa997573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:44.827031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:44.874391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 535/1050] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:44.900658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bdad5-570d-4696-9867-95eab441cb5e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:44.935637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:44.936261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:44.936541 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:44.936809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:44.943438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:44.944873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:44.956518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:44.957429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:44.958416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:44.958416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:44.958416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:44.958416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:44.958416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:44.958416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:44.958416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:44.958416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:44.962612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 516/1051] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:44.963470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193eb83f-865a-4559-95dc-976eaa997573 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:45.066822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193eb83f-865a-4559-95dc-976eaa997573 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:45.103100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:45.103708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:45.103986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:45.104258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:45.104945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:45.105251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:45.106751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:45.123557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 536/1052] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:45.125384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:45.146433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:45.146910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:45.176411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:45.238087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7029e-c63c-47c3-ab85-2a1e45c06d65 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:45.263445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d70a3-1e4e-4e07-a6bf-0343237dd2ce None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:45.274282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:45.274891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:45.275174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:45.275447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:45.276177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] RBAC: Adding query filter params (role.id=78c5de78f20944078beaf3ec85795d46, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=81ac50ea01de4a9d9b76befbcba88845) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:45.276485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:45.277936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:45.286066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 517/1053] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:45 2022] GET /identity/v3/role_assignments?user.id=81ac50ea01de4a9d9b76befbcba88845&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=78c5de78f20944078beaf3ec85795d46 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:45.304284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b83b9-53d2-490a-9ee1-774ed262663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:45.304944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b83b9-53d2-490a-9ee1-774ed262663a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:45.305223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b83b9-53d2-490a-9ee1-774ed262663a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:45.305594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0b83b9-53d2-490a-9ee1-774ed262663a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:45.319384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0b83b9-53d2-490a-9ee1-774ed262663a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-fa0b83b9-53d2-490a-9ee1-774ed262663a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:45.324457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:45.325501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:45.330892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 537/1054] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:45.332370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:45.424797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:45.446987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fc157-c2ff-44ea-b8b7-899f8220d21a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:45.482085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1c112-233b-4915-aaa9-56f342440f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:45.482878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1c112-233b-4915-aaa9-56f342440f20 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:45.483160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1c112-233b-4915-aaa9-56f342440f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:45.483432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1c112-233b-4915-aaa9-56f342440f20 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:45.484096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1c112-233b-4915-aaa9-56f342440f20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:45.484398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1c112-233b-4915-aaa9-56f342440f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:45.485754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1c112-233b-4915-aaa9-56f342440f20 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:45.494569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 518/1055] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:45.500546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b83b9-53d2-490a-9ee1-774ed262663a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:45.597526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee252d-07fd-4242-947b-4388519431ed None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:45.598286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee252d-07fd-4242-947b-4388519431ed None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:45.598566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee252d-07fd-4242-947b-4388519431ed None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:45.600077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 519/1056] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:45.602242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:45.605168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1b65-e09c-4ea0-bda7-133382cd3083 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:45.605447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1b65-e09c-4ea0-bda7-133382cd3083 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:45.605725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a1b65-e09c-4ea0-bda7-133382cd3083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:45.622944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0b83b9-53d2-490a-9ee1-774ed262663a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:45.624657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cc4a1b65-e09c-4ea0-bda7-133382cd3083 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:45.625847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cc4a1b65-e09c-4ea0-bda7-133382cd3083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:45.660243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfda59-7d7f-4c36-abb7-a8a6e2cedf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:45.660882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfda59-7d7f-4c36-abb7-a8a6e2cedf85 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:45.661215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfda59-7d7f-4c36-abb7-a8a6e2cedf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:45.661501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfda59-7d7f-4c36-abb7-a8a6e2cedf85 None admin] PATH_INFO: `/v3/users/fa38c7ac7b59428b828db2ef128f6016` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:45.677704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfda59-7d7f-4c36-abb7-a8a6e2cedf85 None admin] RBAC: Authorizing `identity:get_user(user_id=fa38c7ac7b59428b828db2ef128f6016)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:45.679132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfda59-7d7f-4c36-abb7-a8a6e2cedf85 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:45.686325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 538/1057] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:26:45 2022] GET /identity/v3/users/fa38c7ac7b59428b828db2ef128f6016 => generated 285 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:45.687046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfda59-7d7f-4c36-abb7-a8a6e2cedf85 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:45.698207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 520/1058] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:45.795625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfda59-7d7f-4c36-abb7-a8a6e2cedf85 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:45.831999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6214df-366d-494c-94a7-73aab4b1f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:45.832617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6214df-366d-494c-94a7-73aab4b1f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:45.832906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6214df-366d-494c-94a7-73aab4b1f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:45.833227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6214df-366d-494c-94a7-73aab4b1f9b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:45.844528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:45.905055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6214df-366d-494c-94a7-73aab4b1f9b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:45.906562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6214df-366d-494c-94a7-73aab4b1f9b3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:45.969015 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a1b65-e09c-4ea0-bda7-133382cd3083 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:46.012379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 539/1059] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:26:46.018278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6214df-366d-494c-94a7-73aab4b1f9b3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:46.051765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:46.064826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:46.079915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a1b65-e09c-4ea0-bda7-133382cd3083 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:46.117485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65d863-a666-4155-a51b-1dec963f650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:46.117978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65d863-a666-4155-a51b-1dec963f650d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:46.118269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65d863-a666-4155-a51b-1dec963f650d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:46.118546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65d863-a666-4155-a51b-1dec963f650d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:46.128102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6214df-366d-494c-94a7-73aab4b1f9b3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:46.166880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aa1df-9a9b-4ef9-ad49-6802fa0a01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:46.167517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa1df-9a9b-4ef9-ad49-6802fa0a01a1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:46.167806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa1df-9a9b-4ef9-ad49-6802fa0a01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:46.168084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa1df-9a9b-4ef9-ad49-6802fa0a01a1 None admin] PATH_INFO: `/v3/projects/a4d47e54b49346df86bafb17a6d48889` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:46.170115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683aa1df-9a9b-4ef9-ad49-6802fa0a01a1 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d47e54b49346df86bafb17a6d48889)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:46.171611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683aa1df-9a9b-4ef9-ad49-6802fa0a01a1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:46.173266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 540/1060] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:26:46 2022] GET /identity/v3/projects/a4d47e54b49346df86bafb17a6d48889 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:46.179571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aa1df-9a9b-4ef9-ad49-6802fa0a01a1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:46.196270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65d863-a666-4155-a51b-1dec963f650d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:46.198128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65d863-a666-4155-a51b-1dec963f650d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:46.285651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:46.289374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aa1df-9a9b-4ef9-ad49-6802fa0a01a1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:46.302013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:46.314890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 521/1061] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:26:46.320304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65d863-a666-4155-a51b-1dec963f650d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:46.331259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:46.332050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:46.332227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:46.332504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:46.333267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=a4d47e54b49346df86bafb17a6d48889, user.id=fa38c7ac7b59428b828db2ef128f6016) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:46.333581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:46.335068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:46.349912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 541/1062] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:46 2022] GET /identity/v3/role_assignments?user.id=fa38c7ac7b59428b828db2ef128f6016&scope.project.id=a4d47e54b49346df86bafb17a6d48889&role.id=f21c9b5697b747d39bf8f104797da245 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:46.444275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65d863-a666-4155-a51b-1dec963f650d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:46.481143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fe79e-eb1c-4ca3-9dd5-8058a5899385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:46.482356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe79e-eb1c-4ca3-9dd5-8058a5899385 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:46.483002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe79e-eb1c-4ca3-9dd5-8058a5899385 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:46.483002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe79e-eb1c-4ca3-9dd5-8058a5899385 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:46.494944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fe79e-eb1c-4ca3-9dd5-8058a5899385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:46.496397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fe79e-eb1c-4ca3-9dd5-8058a5899385 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-cb7fe79e-eb1c-4ca3-9dd5-8058a5899385 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:46.511603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:46.512611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:46.513494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:46.513494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:46.513494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:46.513494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 522/1063] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:46.520055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:46.629321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227affa9-2852-4923-9d9c-7296757b33ba None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:46.665997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03299a0-7cb0-490a-98c5-cf99bc018463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:46.666620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03299a0-7cb0-490a-98c5-cf99bc018463 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:46.666907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03299a0-7cb0-490a-98c5-cf99bc018463 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:46.667184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03299a0-7cb0-490a-98c5-cf99bc018463 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:46.667837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03299a0-7cb0-490a-98c5-cf99bc018463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:46.668145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03299a0-7cb0-490a-98c5-cf99bc018463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:46.670545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03299a0-7cb0-490a-98c5-cf99bc018463 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:46.683075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 542/1064] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:47.243341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1906-2187-42dd-97cc-d652657bb41b None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:47.243909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1906-2187-42dd-97cc-d652657bb41b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:47.243909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d1906-2187-42dd-97cc-d652657bb41b None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:47.245253 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 523/1065] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:47.250965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f956f-0700-4f6d-986b-2f7013a23022 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:47.251403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f956f-0700-4f6d-986b-2f7013a23022 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:47.251598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f956f-0700-4f6d-986b-2f7013a23022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:47.270007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1a0f956f-0700-4f6d-986b-2f7013a23022 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:47.271198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1a0f956f-0700-4f6d-986b-2f7013a23022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:47.297093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:47.341066 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 543/1066] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:47.614428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d1906-2187-42dd-97cc-d652657bb41b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:47.642198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:47.718128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d1906-2187-42dd-97cc-d652657bb41b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:47.751247 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb069412-7ac3-4029-bb7a-8d0f0128b3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:47.751871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069412-7ac3-4029-bb7a-8d0f0128b3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:47.752149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069412-7ac3-4029-bb7a-8d0f0128b3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:47.752416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb069412-7ac3-4029-bb7a-8d0f0128b3c7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:47.763044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb069412-7ac3-4029-bb7a-8d0f0128b3c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-eb069412-7ac3-4029-bb7a-8d0f0128b3c7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:47.767780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:47.768787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:47.769644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 524/1067] 10.222.0.88 () {56 vars in 1120 bytes} [Fri Aug 26 00:26:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:47.774872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f956f-0700-4f6d-986b-2f7013a23022 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:47.872243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f956f-0700-4f6d-986b-2f7013a23022 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:47.905366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:47.905989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:47.906271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:47.906541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:47.907195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:47.907496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:47.908859 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:47.916782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 544/1068] 10.222.0.88 () {56 vars in 1115 bytes} [Fri Aug 26 00:26:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:47.922311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb069412-7ac3-4029-bb7a-8d0f0128b3c7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.010283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:48.026519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb069412-7ac3-4029-bb7a-8d0f0128b3c7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:48.061617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00674e8b-2333-4e37-afdd-0d4def97a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:48.062274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674e8b-2333-4e37-afdd-0d4def97a629 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.062562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674e8b-2333-4e37-afdd-0d4def97a629 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.062840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00674e8b-2333-4e37-afdd-0d4def97a629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.072858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674e8b-2333-4e37-afdd-0d4def97a629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:48.074346 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00674e8b-2333-4e37-afdd-0d4def97a629 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-00674e8b-2333-4e37-afdd-0d4def97a629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:48.089448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:48.090497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:48.091377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:48.091377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:48.091377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:48.091377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 525/1069] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:48.096260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.123533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:48.200038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc6800-e7be-4be0-8952-8d4f3f8f714a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:48.234858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:48.235462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.235748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.236025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.236669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:48.236975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:48.238381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:48.251084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 545/1070] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:48.256397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.256542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d8c0-8224-4549-bcd5-1eda7f5978f3 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.256913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d8c0-8224-4549-bcd5-1eda7f5978f3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.256998 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678d8c0-8224-4549-bcd5-1eda7f5978f3 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.258325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 526/1071] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:48.263846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3058a-c2c4-42a2-9e97-c6cf962ac769 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.264130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3058a-c2c4-42a2-9e97-c6cf962ac769 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.264405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3058a-c2c4-42a2-9e97-c6cf962ac769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.284576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6af3058a-c2c4-42a2-9e97-c6cf962ac769 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:48.285790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6af3058a-c2c4-42a2-9e97-c6cf962ac769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:48.344656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:48.354426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 527/1072] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:48.360786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2a538-c67a-47cc-8baa-05fd6be5f326 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:48.394017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:48.394563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.394839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.395110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.401833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:48.403302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:48.414369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:48.415474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:48.416542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 546/1073] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:48.421674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3058a-c2c4-42a2-9e97-c6cf962ac769 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.488160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:48.521250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3058a-c2c4-42a2-9e97-c6cf962ac769 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:48.555915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:48.556530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.556813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.557087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.557816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:48.558151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:48.559603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:48.577932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 528/1074] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:48.583553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.624890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.683841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e8cb8f-f95b-4932-8866-765feb2100d1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:48.717208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:48.717839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.718164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.718432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.723862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fd3ff-f9c8-4a51-84e4-ef16aeb6a723 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:48.729061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:48.730544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:48.733560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:48.745769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:48.747013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:48.748040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:48.748040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:48.748040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:48.748040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 547/1075] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:48.750806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:48.752674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.760498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eb7b8-c2aa-4600-9440-0e282a16ba80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:48.761134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eb7b8-c2aa-4600-9440-0e282a16ba80 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.761419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eb7b8-c2aa-4600-9440-0e282a16ba80 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.761694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0eb7b8-c2aa-4600-9440-0e282a16ba80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.773466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0eb7b8-c2aa-4600-9440-0e282a16ba80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7c0eb7b8-c2aa-4600-9440-0e282a16ba80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:48.778995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:48.780244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:48.781555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:48.785226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 529/1076] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:48.785929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eb7b8-c2aa-4600-9440-0e282a16ba80 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.854765 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb43834-5858-4857-b3a0-29cdc74dd687 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:48.889243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:48.889852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0eb7b8-c2aa-4600-9440-0e282a16ba80 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:48.890008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.890163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.890440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.891087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:48.891397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:48.892772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:48.905166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 548/1077] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:48.910743 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.924197 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:48.924806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:48.925089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:48.925365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:48.926058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:48.926365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:48.927980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:48.940865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 530/1078] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:48.941678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:48.966962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:48.990707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:49.010548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f2fc7-18b6-4f12-8c88-b459b5ec601c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:49.041629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d0a6e5-f8d8-4695-ad77-f3383f18287d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:49.046078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:49.046709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:49.046988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:49.047259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:49.054108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:49.055538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:49.066548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:49.067420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:49.068570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 549/1079] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:49.073347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:49.077506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012a069-5180-4f65-9280-a1d36ed7e453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:49.078174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012a069-5180-4f65-9280-a1d36ed7e453 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:49.078456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012a069-5180-4f65-9280-a1d36ed7e453 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:49.078725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4012a069-5180-4f65-9280-a1d36ed7e453 None admin] PATH_INFO: `/v3/users/fa38c7ac7b59428b828db2ef128f6016` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:49.079875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012a069-5180-4f65-9280-a1d36ed7e453 None admin] RBAC: Authorizing `identity:get_user(user_id=fa38c7ac7b59428b828db2ef128f6016)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:49.081300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4012a069-5180-4f65-9280-a1d36ed7e453 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:49.082905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 531/1080] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:26:48 2022] GET /identity/v3/users/fa38c7ac7b59428b828db2ef128f6016 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:49.088396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012a069-5180-4f65-9280-a1d36ed7e453 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:49.174423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139192d3-becb-4eb7-ac83-ab2e0c9e8392 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:49.191809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4012a069-5180-4f65-9280-a1d36ed7e453 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:49.191959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:49.207984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:49.211542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:49.212142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:49.212424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:49.212696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:49.213382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:49.213688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:49.215154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:49.225372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c893e73-17f9-4f8e-9980-7a52f5db1b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:49.226027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c893e73-17f9-4f8e-9980-7a52f5db1b98 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:49.226311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c893e73-17f9-4f8e-9980-7a52f5db1b98 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:49.226550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 550/1081] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:49.226679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c893e73-17f9-4f8e-9980-7a52f5db1b98 None admin] PATH_INFO: `/v3/projects/a4d47e54b49346df86bafb17a6d48889` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:49.227678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c893e73-17f9-4f8e-9980-7a52f5db1b98 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d47e54b49346df86bafb17a6d48889)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:49.229088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c893e73-17f9-4f8e-9980-7a52f5db1b98 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:49.230737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 532/1082] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:26:49 2022] GET /identity/v3/projects/a4d47e54b49346df86bafb17a6d48889 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:49.232937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:49.236703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c893e73-17f9-4f8e-9980-7a52f5db1b98 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:49.335184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e729cdf-d6b3-4738-9db3-4198d579d1d4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:49.337784 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c893e73-17f9-4f8e-9980-7a52f5db1b98 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:49.368759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a07731a-b8d2-4d1f-b973-88c15719bef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:49.369407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07731a-b8d2-4d1f-b973-88c15719bef4 None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:49.369692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07731a-b8d2-4d1f-b973-88c15719bef4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:49.369994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a07731a-b8d2-4d1f-b973-88c15719bef4 None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/81ac50ea01de4a9d9b76befbcba88845/roles/78c5de78f20944078beaf3ec85795d46` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:49.372215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b0210-5f0e-4bbd-91bc-de6300b81517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:49.372646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07731a-b8d2-4d1f-b973-88c15719bef4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=81ac50ea01de4a9d9b76befbcba88845, role_id=78c5de78f20944078beaf3ec85795d46)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:49.372874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b0210-5f0e-4bbd-91bc-de6300b81517 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:49.373154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b0210-5f0e-4bbd-91bc-de6300b81517 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:49.373430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b0210-5f0e-4bbd-91bc-de6300b81517 None admin] PATH_INFO: `/v3/projects/a4d47e54b49346df86bafb17a6d48889/users/fa38c7ac7b59428b828db2ef128f6016/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:49.374096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a07731a-b8d2-4d1f-b973-88c15719bef4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:49.375401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b0210-5f0e-4bbd-91bc-de6300b81517 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4d47e54b49346df86bafb17a6d48889, user_id=fa38c7ac7b59428b828db2ef128f6016, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:49.376817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713b0210-5f0e-4bbd-91bc-de6300b81517 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:49.388926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 551/1083] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:26:49 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/81ac50ea01de4a9d9b76befbcba88845/roles/78c5de78f20944078beaf3ec85795d46 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:26:49.391797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 533/1084] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:26:49 2022] PUT /identity/v3/projects/a4d47e54b49346df86bafb17a6d48889/users/fa38c7ac7b59428b828db2ef128f6016/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:26:51.303665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd7a4-b637-4f74-97c9-4a3f2045f39f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:51.304204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd7a4-b637-4f74-97c9-4a3f2045f39f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:51.304204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976bd7a4-b637-4f74-97c9-4a3f2045f39f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:51.305531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 552/1085] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:51.310631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172b385-58b0-467c-b4ac-09e69e64eaa2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:51.311090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172b385-58b0-467c-b4ac-09e69e64eaa2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:51.311202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172b385-58b0-467c-b4ac-09e69e64eaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:51.322368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccaea-acfe-4a2f-94e0-08dd5123fbe4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:51.322656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccaea-acfe-4a2f-94e0-08dd5123fbe4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:51.322937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fccaea-acfe-4a2f-94e0-08dd5123fbe4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:51.324243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 553/1086] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:26:51.329513 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f769-fbbb-4b5f-bbaf-71502fbc8600 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:51.329798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f769-fbbb-4b5f-bbaf-71502fbc8600 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:51.329939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7172b385-58b0-467c-b4ac-09e69e64eaa2 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:51.330119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a046f769-fbbb-4b5f-bbaf-71502fbc8600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:51.331058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7172b385-58b0-467c-b4ac-09e69e64eaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:51.348292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a046f769-fbbb-4b5f-bbaf-71502fbc8600 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:51.349473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a046f769-fbbb-4b5f-bbaf-71502fbc8600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:51.372931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:51.379836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:51.400989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 534/1087] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:51.419212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 554/1088] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:26:51.674544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172b385-58b0-467c-b4ac-09e69e64eaa2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:51.687147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046f769-fbbb-4b5f-bbaf-71502fbc8600 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:51.774561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172b385-58b0-467c-b4ac-09e69e64eaa2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:51.785377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a046f769-fbbb-4b5f-bbaf-71502fbc8600 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:51.810215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2ea9-be2b-4c2e-b19d-a1fe360be47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:51.810849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2ea9-be2b-4c2e-b19d-a1fe360be47e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:51.811133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2ea9-be2b-4c2e-b19d-a1fe360be47e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:51.811410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eb2ea9-be2b-4c2e-b19d-a1fe360be47e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:51.819263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49c75-f836-46af-8e33-0af9ee8f25ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:51.819892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49c75-f836-46af-8e33-0af9ee8f25ac None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:51.820177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49c75-f836-46af-8e33-0af9ee8f25ac None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:51.820459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49c75-f836-46af-8e33-0af9ee8f25ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:51.821372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69eb2ea9-be2b-4c2e-b19d-a1fe360be47e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-69eb2ea9-be2b-4c2e-b19d-a1fe360be47e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:51.826796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:51.827834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:51.828755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 535/1089] 10.222.0.88 () {56 vars in 1120 bytes} [Fri Aug 26 00:26:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:51.833695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2ea9-be2b-4c2e-b19d-a1fe360be47e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:51.836525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49c75-f836-46af-8e33-0af9ee8f25ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-22d49c75-f836-46af-8e33-0af9ee8f25ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:26:51.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:51.843360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:51.844190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 555/1090] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:51.849610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49c75-f836-46af-8e33-0af9ee8f25ac None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:51.870820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:51.879065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:51.939020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69eb2ea9-be2b-4c2e-b19d-a1fe360be47e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:51.953242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49c75-f836-46af-8e33-0af9ee8f25ac None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:51.973750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:51.974465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:51.974740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:51.975014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:51.975679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:51.975987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:51.977355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:51.985097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 536/1091] 10.222.0.88 () {56 vars in 1115 bytes} [Fri Aug 26 00:26:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:51.988252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:51.988861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:51.989146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:51.989425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:51.990244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:51.990552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:51.990660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:51.992014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.000620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 556/1092] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:26:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:52.006671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:52.089917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:52.097299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597aa767-a214-4cce-9994-19757a553ef5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.099880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:52.112791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5c2e36-7dc7-401c-bfa1-5a0b0d8b58de None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.131890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.132528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.132819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.133096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.144341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.145791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.150250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b5cf-eaeb-461c-aa89-e70e6cf51753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.151271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b5cf-eaeb-461c-aa89-e70e6cf51753 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.151562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b5cf-eaeb-461c-aa89-e70e6cf51753 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.151843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d274b5cf-eaeb-461c-aa89-e70e6cf51753 None admin] PATH_INFO: `/v3/users/fa38c7ac7b59428b828db2ef128f6016` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.153752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b5cf-eaeb-461c-aa89-e70e6cf51753 None admin] RBAC: Authorizing `identity:get_user(user_id=fa38c7ac7b59428b828db2ef128f6016)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.155440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d274b5cf-eaeb-461c-aa89-e70e6cf51753 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.157031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 557/1093] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/users/fa38c7ac7b59428b828db2ef128f6016 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:52.162190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:52.163271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:52.164181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:52.164181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:52.164181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:52.164352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b5cf-eaeb-461c-aa89-e70e6cf51753 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:52.167979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 537/1094] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:52.168994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:52.263462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d274b5cf-eaeb-461c-aa89-e70e6cf51753 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.274613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55021f51-4557-42bd-b4a4-ab9bcc79ec2d None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.298155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24236c7c-887b-44fc-b9e1-b95094012abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.298763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236c7c-887b-44fc-b9e1-b95094012abf None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.299044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236c7c-887b-44fc-b9e1-b95094012abf None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.299320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24236c7c-887b-44fc-b9e1-b95094012abf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.308396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.309591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.309999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.310249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.310897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:52.311453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.312566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.324335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 538/1095] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:52.324498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:52.330681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:52.341612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:52.374139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24236c7c-887b-44fc-b9e1-b95094012abf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.375596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24236c7c-887b-44fc-b9e1-b95094012abf None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.433705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d782d-1cba-4f6b-9369-ce6c2ec78877 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.468819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.469442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.469726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.470042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.477016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.478502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.488036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 558/1096] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:26:52.490217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:52.491421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:26:52.492537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 539/1097] 10.222.0.88 () {56 vars in 1093 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:26:52.494325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24236c7c-887b-44fc-b9e1-b95094012abf None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:52.497524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:52.550057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:52.564905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:52.596522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24236c7c-887b-44fc-b9e1-b95094012abf None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.601191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f7ba0-d1ba-4983-a298-843e3a9830a5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.630642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9f30-1c88-40f4-b674-5e13296d8241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.631271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9f30-1c88-40f4-b674-5e13296d8241 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.631549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9f30-1c88-40f4-b674-5e13296d8241 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.631832 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c9f30-1c88-40f4-b674-5e13296d8241 None admin] PATH_INFO: `/v3/projects/a4d47e54b49346df86bafb17a6d48889` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.632936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9f30-1c88-40f4-b674-5e13296d8241 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d47e54b49346df86bafb17a6d48889)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.634427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c9f30-1c88-40f4-b674-5e13296d8241 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.636089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 559/1098] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/projects/a4d47e54b49346df86bafb17a6d48889 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:52.638371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.638997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.639287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.639568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.640365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:52.640678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.642144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.642482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9f30-1c88-40f4-b674-5e13296d8241 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:52.659674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 540/1099] 10.222.0.88 () {56 vars in 1133 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:52.665428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:52.743277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c9f30-1c88-40f4-b674-5e13296d8241 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.764295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd9165-13c5-4248-9941-714898044f47 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:52.768320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:52.780326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.780943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.781229 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.781505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.782261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=a4d47e54b49346df86bafb17a6d48889, user.id=fa38c7ac7b59428b828db2ef128f6016) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:52.782581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.784053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.789826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 560/1100] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/role_assignments?user.id=fa38c7ac7b59428b828db2ef128f6016&scope.project.id=a4d47e54b49346df86bafb17a6d48889&role.id=f21c9b5697b747d39bf8f104797da245 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:26:52.790795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:52.801112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d7cdb-364a-48ac-b480-bf49c7b900b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:52.802178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7cdb-364a-48ac-b480-bf49c7b900b2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:52.802492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7cdb-364a-48ac-b480-bf49c7b900b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:52.802769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d7cdb-364a-48ac-b480-bf49c7b900b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:52.877567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d7cdb-364a-48ac-b480-bf49c7b900b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:52.879009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7d7cdb-364a-48ac-b480-bf49c7b900b2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:52.984378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 541/1101] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:26:52.990259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:53.095122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9348a6-cc87-4a2c-8a2d-432bc557fde5 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:53.129786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:53.130368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:53.130801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:53.131090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:53.142234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:53.143781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:26:53.157742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:53.158821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:26:53.160096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:26:53.160096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:26:53.160096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:53.160096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 561/1102] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:53.164582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d7cdb-364a-48ac-b480-bf49c7b900b2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:53.191557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:53.263894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d7cdb-364a-48ac-b480-bf49c7b900b2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:53.297706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:53.298343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:53.298627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:53.298901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:53.299540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:53.299845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:53.301212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:53.313335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 542/1103] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:53.318869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:53.362797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:53.420311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f65ba-35e5-472a-b94f-d3397ac1c9b1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:53.454543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:53.455240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:53.455510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:53.455780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:53.462403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:53.463852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:26:53.475347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:26:53.476314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:26:53.477225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 562/1104] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:26:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:26:53.483396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:53.573343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:53.588099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbaaa8-6c61-4862-bc2a-31f33300a787 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:53.620678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1356970c-69eb-4a48-8c99-33e68d8449bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:53.621273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356970c-69eb-4a48-8c99-33e68d8449bf None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:53.622398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356970c-69eb-4a48-8c99-33e68d8449bf None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:53.622620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1356970c-69eb-4a48-8c99-33e68d8449bf None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:53.623310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356970c-69eb-4a48-8c99-33e68d8449bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:53.623612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356970c-69eb-4a48-8c99-33e68d8449bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:53.625024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1356970c-69eb-4a48-8c99-33e68d8449bf None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:53.636600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 543/1105] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:26:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:53.642849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:53.740001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:53.743177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452cd4a-2e10-44a0-a2b1-52cd80814e50 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:53.776160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73919e3e-8756-4a69-b0ab-4bdfedc73c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:53.776752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73919e3e-8756-4a69-b0ab-4bdfedc73c20 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:53.777031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73919e3e-8756-4a69-b0ab-4bdfedc73c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:53.777329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73919e3e-8756-4a69-b0ab-4bdfedc73c20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:53.778627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73919e3e-8756-4a69-b0ab-4bdfedc73c20 None admin] RBAC: Adding query filter params (role.id=78c5de78f20944078beaf3ec85795d46, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=81ac50ea01de4a9d9b76befbcba88845) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:53.778999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73919e3e-8756-4a69-b0ab-4bdfedc73c20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:53.780289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73919e3e-8756-4a69-b0ab-4bdfedc73c20 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:53.786012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 563/1106] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:53 2022] GET /identity/v3/role_assignments?user.id=81ac50ea01de4a9d9b76befbcba88845&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=78c5de78f20944078beaf3ec85795d46 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:54.801130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e53cdf-06fc-4f14-b262-39fd744f26d2 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:54.801950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e53cdf-06fc-4f14-b262-39fd744f26d2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:54.801950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e53cdf-06fc-4f14-b262-39fd744f26d2 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:54.803302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 544/1107] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:54.808415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e301-191f-4199-9942-12ceb00af83b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:54.809370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e301-191f-4199-9942-12ceb00af83b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:54.809486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231e301-191f-4199-9942-12ceb00af83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:54.828150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2231e301-191f-4199-9942-12ceb00af83b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:54.829253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2231e301-191f-4199-9942-12ceb00af83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:54.896437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 564/1108] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:55.173829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e53cdf-06fc-4f14-b262-39fd744f26d2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:55.272104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e53cdf-06fc-4f14-b262-39fd744f26d2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:55.306174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf751fc5-7226-4c42-b878-36cfcb6eccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:55.306794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf751fc5-7226-4c42-b878-36cfcb6eccdc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:55.307078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf751fc5-7226-4c42-b878-36cfcb6eccdc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:55.307407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf751fc5-7226-4c42-b878-36cfcb6eccdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:55.308512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf751fc5-7226-4c42-b878-36cfcb6eccdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:55.310132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf751fc5-7226-4c42-b878-36cfcb6eccdc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:55.311684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 545/1109] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:26:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:55.317529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231e301-191f-4199-9942-12ceb00af83b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:55.408063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:55.414875 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231e301-191f-4199-9942-12ceb00af83b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:55.448118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f600ac93-ef3f-408d-ab8f-35af52a7e45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:55.448654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600ac93-ef3f-408d-ab8f-35af52a7e45e None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:55.448931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600ac93-ef3f-408d-ab8f-35af52a7e45e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:55.449201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f600ac93-ef3f-408d-ab8f-35af52a7e45e None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:55.450037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600ac93-ef3f-408d-ab8f-35af52a7e45e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:55.451460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f600ac93-ef3f-408d-ab8f-35af52a7e45e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:55.477051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 565/1110] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:26:55 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:26:57.406663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524198-c19e-44b2-9178-ff1beb8aa100 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:57.407203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524198-c19e-44b2-9178-ff1beb8aa100 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:57.407203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61524198-c19e-44b2-9178-ff1beb8aa100 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:57.408557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 546/1111] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:26:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:26:57.413779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702edf33-c246-4111-8844-e373784ee352 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:57.414202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702edf33-c246-4111-8844-e373784ee352 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:57.414366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702edf33-c246-4111-8844-e373784ee352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:57.433569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-702edf33-c246-4111-8844-e373784ee352 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:26:57.435599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-702edf33-c246-4111-8844-e373784ee352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:26:57.502674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 566/1112] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:26:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:26:57.773565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524198-c19e-44b2-9178-ff1beb8aa100 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:57.789103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:57.875382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61524198-c19e-44b2-9178-ff1beb8aa100 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:57.908633 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0b021-d400-4462-95a3-3eb5b79ca2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:57.909250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0b021-d400-4462-95a3-3eb5b79ca2ee None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:57.909532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0b021-d400-4462-95a3-3eb5b79ca2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:57.909806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0b021-d400-4462-95a3-3eb5b79ca2ee None admin] PATH_INFO: `/v3/roles/04b06cf4afbb4f3fa6cb347496ae7a81` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:57.911220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0b021-d400-4462-95a3-3eb5b79ca2ee None admin] RBAC: Authorizing `identity:get_role(role_id=04b06cf4afbb4f3fa6cb347496ae7a81)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:57.912585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0b021-d400-4462-95a3-3eb5b79ca2ee None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:57.913908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 547/1113] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:26:57 2022] GET /identity/v3/roles/04b06cf4afbb4f3fa6cb347496ae7a81 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:57.920209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702edf33-c246-4111-8844-e373784ee352 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:57.999046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:58.018424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702edf33-c246-4111-8844-e373784ee352 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:58.051831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e345f6-7a8c-419b-a34e-a3afe29ef738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:58.052402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e345f6-7a8c-419b-a34e-a3afe29ef738 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:58.052687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e345f6-7a8c-419b-a34e-a3afe29ef738 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:58.052963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e345f6-7a8c-419b-a34e-a3afe29ef738 None admin] PATH_INFO: `/v3/users/309365160c9e427c8ee1c0ad1310ba08` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:58.066307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e345f6-7a8c-419b-a34e-a3afe29ef738 None admin] RBAC: Authorizing `identity:get_user(user_id=309365160c9e427c8ee1c0ad1310ba08)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:58.067755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e345f6-7a8c-419b-a34e-a3afe29ef738 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:58.069344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 567/1114] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:26:57 2022] GET /identity/v3/users/309365160c9e427c8ee1c0ad1310ba08 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:58.075379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0b021-d400-4462-95a3-3eb5b79ca2ee None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:58.155481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:58.174279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0b021-d400-4462-95a3-3eb5b79ca2ee None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:58.208013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d53b4-6de8-40fe-a4e4-a32009ba7bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:58.208613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d53b4-6de8-40fe-a4e4-a32009ba7bda None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:58.208897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d53b4-6de8-40fe-a4e4-a32009ba7bda None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:58.209174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d53b4-6de8-40fe-a4e4-a32009ba7bda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:58.274257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d53b4-6de8-40fe-a4e4-a32009ba7bda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:58.275721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d53b4-6de8-40fe-a4e4-a32009ba7bda None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:58.353011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:26:58.371942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 548/1115] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:26:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:26:58.377969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e345f6-7a8c-419b-a34e-a3afe29ef738 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:58.475867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e345f6-7a8c-419b-a34e-a3afe29ef738 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:58.509483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c5d696-372c-4961-a117-32aa05cf2ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:58.510126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d696-372c-4961-a117-32aa05cf2ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:58.510406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d696-372c-4961-a117-32aa05cf2ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:58.510677 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c5d696-372c-4961-a117-32aa05cf2ee9 None admin] PATH_INFO: `/v3/projects/a4d47e54b49346df86bafb17a6d48889` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:58.511973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5d696-372c-4961-a117-32aa05cf2ee9 None admin] RBAC: Authorizing `identity:get_project(project_id=a4d47e54b49346df86bafb17a6d48889)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:58.513412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c5d696-372c-4961-a117-32aa05cf2ee9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:58.515049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 568/1116] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:26:58 2022] GET /identity/v3/projects/a4d47e54b49346df86bafb17a6d48889 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:26:58.521268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d53b4-6de8-40fe-a4e4-a32009ba7bda None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:26:58.619993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d53b4-6de8-40fe-a4e4-a32009ba7bda None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:26:58.654029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318ff6af-9ebd-4a2d-91ec-48c0b9b12cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:26:58.654631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ff6af-9ebd-4a2d-91ec-48c0b9b12cab None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:26:58.654916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ff6af-9ebd-4a2d-91ec-48c0b9b12cab None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:26:58.655194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318ff6af-9ebd-4a2d-91ec-48c0b9b12cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:26:58.655918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ff6af-9ebd-4a2d-91ec-48c0b9b12cab None admin] RBAC: Adding query filter params (role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=a4d47e54b49346df86bafb17a6d48889, user.id=309365160c9e427c8ee1c0ad1310ba08) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:26:58.656232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ff6af-9ebd-4a2d-91ec-48c0b9b12cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:26:58.657663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318ff6af-9ebd-4a2d-91ec-48c0b9b12cab None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:26:58.663085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 549/1117] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:26:58 2022] GET /identity/v3/role_assignments?user.id=309365160c9e427c8ee1c0ad1310ba08&scope.project.id=a4d47e54b49346df86bafb17a6d48889&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:00.530468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d50c6-cd5e-4896-a0cb-6b6155db31cb None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:00.531015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d50c6-cd5e-4896-a0cb-6b6155db31cb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:00.531155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d50c6-cd5e-4896-a0cb-6b6155db31cb None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:00.532367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 569/1118] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:00.537474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898816d-5273-49c7-bdcd-8592f7e80e14 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:00.537915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898816d-5273-49c7-bdcd-8592f7e80e14 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:00.538139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898816d-5273-49c7-bdcd-8592f7e80e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:00.556184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f898816d-5273-49c7-bdcd-8592f7e80e14 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:00.557375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f898816d-5273-49c7-bdcd-8592f7e80e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:00.600105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:00.625414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 550/1119] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:00.891573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d50c6-cd5e-4896-a0cb-6b6155db31cb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:00.900562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:00.991860 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d50c6-cd5e-4896-a0cb-6b6155db31cb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:01.024922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98d4ae-804f-405b-89a3-81fd7d2691f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:01.025544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98d4ae-804f-405b-89a3-81fd7d2691f3 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:01.025824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98d4ae-804f-405b-89a3-81fd7d2691f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:01.026122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98d4ae-804f-405b-89a3-81fd7d2691f3 None admin] PATH_INFO: `/v3/roles/04b06cf4afbb4f3fa6cb347496ae7a81` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:01.027512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98d4ae-804f-405b-89a3-81fd7d2691f3 None admin] RBAC: Authorizing `identity:get_role(role_id=04b06cf4afbb4f3fa6cb347496ae7a81)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:01.028889 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98d4ae-804f-405b-89a3-81fd7d2691f3 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:01.030221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 570/1120] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:00 2022] GET /identity/v3/roles/04b06cf4afbb4f3fa6cb347496ae7a81 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:01.036078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898816d-5273-49c7-bdcd-8592f7e80e14 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:01.134716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898816d-5273-49c7-bdcd-8592f7e80e14 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:01.167367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787a1fc-f1d7-47db-8b50-a6a338480a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:01.168477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787a1fc-f1d7-47db-8b50-a6a338480a61 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:01.168763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787a1fc-f1d7-47db-8b50-a6a338480a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:01.169038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787a1fc-f1d7-47db-8b50-a6a338480a61 None admin] PATH_INFO: `/v3/users/309365160c9e427c8ee1c0ad1310ba08` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:01.170185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787a1fc-f1d7-47db-8b50-a6a338480a61 None admin] RBAC: Authorizing `identity:get_user(user_id=309365160c9e427c8ee1c0ad1310ba08)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:01.171698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787a1fc-f1d7-47db-8b50-a6a338480a61 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:01.173276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 551/1121] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:01 2022] GET /identity/v3/users/309365160c9e427c8ee1c0ad1310ba08 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:01.179312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98d4ae-804f-405b-89a3-81fd7d2691f3 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:01.252590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:01.276870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98d4ae-804f-405b-89a3-81fd7d2691f3 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:01.310869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79930a1f-295f-45f2-82df-dc0b3872faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:01.311488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930a1f-295f-45f2-82df-dc0b3872faec None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:01.311771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930a1f-295f-45f2-82df-dc0b3872faec None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:01.312047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79930a1f-295f-45f2-82df-dc0b3872faec None admin] PATH_INFO: `/v3/projects/a4d47e54b49346df86bafb17a6d48889` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:01.313158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79930a1f-295f-45f2-82df-dc0b3872faec None admin] RBAC: Authorizing `identity:get_project(project_id=a4d47e54b49346df86bafb17a6d48889)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:01.314630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79930a1f-295f-45f2-82df-dc0b3872faec None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:01.316244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 571/1122] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:27:01 2022] GET /identity/v3/projects/a4d47e54b49346df86bafb17a6d48889 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:01.322224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787a1fc-f1d7-47db-8b50-a6a338480a61 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:01.368032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:01.421364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787a1fc-f1d7-47db-8b50-a6a338480a61 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:01.454010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f58e18-a653-49bc-a327-743de791aa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:01.454664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f58e18-a653-49bc-a327-743de791aa91 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:01.454946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f58e18-a653-49bc-a327-743de791aa91 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:01.455221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f58e18-a653-49bc-a327-743de791aa91 None admin] PATH_INFO: `/v3/projects/a4d47e54b49346df86bafb17a6d48889/users/309365160c9e427c8ee1c0ad1310ba08/roles/04b06cf4afbb4f3fa6cb347496ae7a81` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:01.457337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f58e18-a653-49bc-a327-743de791aa91 None admin] RBAC: Authorizing `identity:create_grant(project_id=a4d47e54b49346df86bafb17a6d48889, user_id=309365160c9e427c8ee1c0ad1310ba08, role_id=04b06cf4afbb4f3fa6cb347496ae7a81)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:01.458801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f58e18-a653-49bc-a327-743de791aa91 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:01.471866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 552/1123] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:27:01 2022] PUT /identity/v3/projects/a4d47e54b49346df86bafb17a6d48889/users/309365160c9e427c8ee1c0ad1310ba08/roles/04b06cf4afbb4f3fa6cb347496ae7a81 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:27:03.396670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243be0-f9fd-476e-8ef4-94e6fd43ca07 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:03.397245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243be0-f9fd-476e-8ef4-94e6fd43ca07 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:03.397348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94243be0-f9fd-476e-8ef4-94e6fd43ca07 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:03.398690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 572/1124] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:03.404825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1c89-4349-4577-8b03-db89cb34d1df None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:03.405253 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1c89-4349-4577-8b03-db89cb34d1df None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:03.405403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd1c89-4349-4577-8b03-db89cb34d1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:03.423058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cacd1c89-4349-4577-8b03-db89cb34d1df None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:03.424234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cacd1c89-4349-4577-8b03-db89cb34d1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:03.490488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 553/1125] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:03.769364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243be0-f9fd-476e-8ef4-94e6fd43ca07 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:03.872596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94243be0-f9fd-476e-8ef4-94e6fd43ca07 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:03.906784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab653018-54de-465c-8f3a-65d14d597ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:03.907400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab653018-54de-465c-8f3a-65d14d597ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:03.907682 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab653018-54de-465c-8f3a-65d14d597ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:03.907956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab653018-54de-465c-8f3a-65d14d597ea1 None admin] PATH_INFO: `/v3/roles/04b06cf4afbb4f3fa6cb347496ae7a81` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:03.909319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab653018-54de-465c-8f3a-65d14d597ea1 None admin] RBAC: Authorizing `identity:get_role(role_id=04b06cf4afbb4f3fa6cb347496ae7a81)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:03.910716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab653018-54de-465c-8f3a-65d14d597ea1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:03.912015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 573/1126] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:03 2022] GET /identity/v3/roles/04b06cf4afbb4f3fa6cb347496ae7a81 => generated 223 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:03.917818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd1c89-4349-4577-8b03-db89cb34d1df None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:03.951114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:04.016472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd1c89-4349-4577-8b03-db89cb34d1df None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:04.049747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab667724-f28b-41f7-b53f-d1f494785dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:04.050341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab667724-f28b-41f7-b53f-d1f494785dd7 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:04.050626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab667724-f28b-41f7-b53f-d1f494785dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:04.050905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab667724-f28b-41f7-b53f-d1f494785dd7 None admin] PATH_INFO: `/v3/users/309365160c9e427c8ee1c0ad1310ba08` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:04.052277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab667724-f28b-41f7-b53f-d1f494785dd7 None admin] RBAC: Authorizing `identity:get_user(user_id=309365160c9e427c8ee1c0ad1310ba08)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:04.053782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab667724-f28b-41f7-b53f-d1f494785dd7 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:04.055389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 554/1127] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:03 2022] GET /identity/v3/users/309365160c9e427c8ee1c0ad1310ba08 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:04.061345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab653018-54de-465c-8f3a-65d14d597ea1 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:04.073438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:04.160320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab653018-54de-465c-8f3a-65d14d597ea1 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:04.194095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac931f17-d441-4f02-a9ba-39eabdf7f4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:04.194700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931f17-d441-4f02-a9ba-39eabdf7f4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:04.194986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931f17-d441-4f02-a9ba-39eabdf7f4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:04.195262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac931f17-d441-4f02-a9ba-39eabdf7f4c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:04.261605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac931f17-d441-4f02-a9ba-39eabdf7f4c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:04.263115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac931f17-d441-4f02-a9ba-39eabdf7f4c6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:04.274274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:04.360843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 574/1128] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:27:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:27:04.366743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab667724-f28b-41f7-b53f-d1f494785dd7 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:04.465638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab667724-f28b-41f7-b53f-d1f494785dd7 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:04.467190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:04.500770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf25e2-97cb-44f1-9a03-40d4f7b37b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:04.501398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf25e2-97cb-44f1-9a03-40d4f7b37b1d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:04.501682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf25e2-97cb-44f1-9a03-40d4f7b37b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:04.501986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf25e2-97cb-44f1-9a03-40d4f7b37b1d None admin] PATH_INFO: `/v3/projects/a4d47e54b49346df86bafb17a6d48889` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:04.503105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf25e2-97cb-44f1-9a03-40d4f7b37b1d None admin] RBAC: Authorizing `identity:get_project(project_id=a4d47e54b49346df86bafb17a6d48889)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:04.504538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf25e2-97cb-44f1-9a03-40d4f7b37b1d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:04.506208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 555/1129] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:27:04 2022] GET /identity/v3/projects/a4d47e54b49346df86bafb17a6d48889 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:04.513187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac931f17-d441-4f02-a9ba-39eabdf7f4c6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:04.615826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac931f17-d441-4f02-a9ba-39eabdf7f4c6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:04.628097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:04.651477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbd22d0-f2fa-4c4a-a30d-91dcdc121abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:04.652129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd22d0-f2fa-4c4a-a30d-91dcdc121abb None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:04.652655 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd22d0-f2fa-4c4a-a30d-91dcdc121abb None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:04.652954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbd22d0-f2fa-4c4a-a30d-91dcdc121abb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:04.653682 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd22d0-f2fa-4c4a-a30d-91dcdc121abb None admin] RBAC: Adding query filter params (role.id=04b06cf4afbb4f3fa6cb347496ae7a81, scope.project.id=a4d47e54b49346df86bafb17a6d48889, user.id=309365160c9e427c8ee1c0ad1310ba08) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:04.654031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd22d0-f2fa-4c4a-a30d-91dcdc121abb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:04.655464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbd22d0-f2fa-4c4a-a30d-91dcdc121abb None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:04.661075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 575/1130] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:27:04 2022] GET /identity/v3/role_assignments?user.id=309365160c9e427c8ee1c0ad1310ba08&scope.project.id=a4d47e54b49346df86bafb17a6d48889&role.id=04b06cf4afbb4f3fa6cb347496ae7a81 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:06.594488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935097-694a-4bd9-b7ad-c8f4e52130d6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:06.594952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935097-694a-4bd9-b7ad-c8f4e52130d6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:06.595045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c935097-694a-4bd9-b7ad-c8f4e52130d6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:06.596381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 556/1131] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:06.601623 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240399d-98a0-4f05-bfd0-023b72af5917 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:06.602065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240399d-98a0-4f05-bfd0-023b72af5917 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:06.602289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e240399d-98a0-4f05-bfd0-023b72af5917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:06.620519 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e240399d-98a0-4f05-bfd0-023b72af5917 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:06.621916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e240399d-98a0-4f05-bfd0-023b72af5917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:06.687631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 576/1132] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:06.960130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c935097-694a-4bd9-b7ad-c8f4e52130d6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:07.059464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c935097-694a-4bd9-b7ad-c8f4e52130d6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:07.092769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96673197-c6f5-4d91-91f4-62f6d6e65ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:07.093382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673197-c6f5-4d91-91f4-62f6d6e65ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:07.093662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673197-c6f5-4d91-91f4-62f6d6e65ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:07.094129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96673197-c6f5-4d91-91f4-62f6d6e65ce2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:07.095241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96673197-c6f5-4d91-91f4-62f6d6e65ce2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:07.096663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96673197-c6f5-4d91-91f4-62f6d6e65ce2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:07.098236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 557/1133] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:07.104109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240399d-98a0-4f05-bfd0-023b72af5917 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:07.204093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e240399d-98a0-4f05-bfd0-023b72af5917 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:07.206396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:07.237676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db819-9987-48b0-99b0-11546dabca54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:07.238312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db819-9987-48b0-99b0-11546dabca54 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:07.238601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db819-9987-48b0-99b0-11546dabca54 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:07.238878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db819-9987-48b0-99b0-11546dabca54 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:07.239517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db819-9987-48b0-99b0-11546dabca54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:07.240962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db819-9987-48b0-99b0-11546dabca54 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:07.268293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 577/1134] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:27:07 2022] POST /identity/v3/projects => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:27:09.180286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff308d-2a0c-4a1b-bc89-f79ac81fc205 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:09.180825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff308d-2a0c-4a1b-bc89-f79ac81fc205 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:09.180825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff308d-2a0c-4a1b-bc89-f79ac81fc205 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:09.182214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 558/1135] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:09.188201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50431b84-2de1-473a-916f-7b1c51a97db4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:09.188606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50431b84-2de1-473a-916f-7b1c51a97db4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:09.188761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50431b84-2de1-473a-916f-7b1c51a97db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:09.208638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-50431b84-2de1-473a-916f-7b1c51a97db4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:09.209273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-50431b84-2de1-473a-916f-7b1c51a97db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:09.275732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 578/1136] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:09.548024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff308d-2a0c-4a1b-bc89-f79ac81fc205 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:09.592035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:09.653089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff308d-2a0c-4a1b-bc89-f79ac81fc205 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:09.688743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0946ea1-e29f-46a3-83a3-8c64de94da5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:09.689371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946ea1-e29f-46a3-83a3-8c64de94da5b None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:09.689656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946ea1-e29f-46a3-83a3-8c64de94da5b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:09.689958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0946ea1-e29f-46a3-83a3-8c64de94da5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:09.691067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946ea1-e29f-46a3-83a3-8c64de94da5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:09.692503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0946ea1-e29f-46a3-83a3-8c64de94da5b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:09.694119 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 559/1137] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:27:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:09.700218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50431b84-2de1-473a-916f-7b1c51a97db4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:09.782438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:09.798398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50431b84-2de1-473a-916f-7b1c51a97db4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:09.832135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4697c9-18d2-4440-8894-158946d2161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:09.832732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4697c9-18d2-4440-8894-158946d2161e None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:09.833010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4697c9-18d2-4440-8894-158946d2161e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:09.833285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4697c9-18d2-4440-8894-158946d2161e None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:09.833951 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4697c9-18d2-4440-8894-158946d2161e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:09.835378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4697c9-18d2-4440-8894-158946d2161e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:09.856273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 579/1138] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:27:09 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:27:11.830586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396a7a9-f992-4536-b9d9-e1f9d7ef84c9 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:11.831102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396a7a9-f992-4536-b9d9-e1f9d7ef84c9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:11.831102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3396a7a9-f992-4536-b9d9-e1f9d7ef84c9 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:11.832403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 560/1139] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:11.837785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bdf3d-d3ca-4bd1-8416-a2cfee248415 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:11.838288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bdf3d-d3ca-4bd1-8416-a2cfee248415 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:11.838382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7bdf3d-d3ca-4bd1-8416-a2cfee248415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:11.857861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ce7bdf3d-d3ca-4bd1-8416-a2cfee248415 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:11.859097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ce7bdf3d-d3ca-4bd1-8416-a2cfee248415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:11.926502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 580/1140] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:12.191776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396a7a9-f992-4536-b9d9-e1f9d7ef84c9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:12.291833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3396a7a9-f992-4536-b9d9-e1f9d7ef84c9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:12.299501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:12.325986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0a285-9c8a-44f3-8bb5-62c4c24746d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:12.326608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0a285-9c8a-44f3-8bb5-62c4c24746d2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:12.326889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0a285-9c8a-44f3-8bb5-62c4c24746d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:12.327165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0a285-9c8a-44f3-8bb5-62c4c24746d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:12.336883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0a285-9c8a-44f3-8bb5-62c4c24746d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b2d0a285-9c8a-44f3-8bb5-62c4c24746d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:27:12.341714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:27:12.342843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:27:12.343909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 561/1141] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:27:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:27:12.348774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bdf3d-d3ca-4bd1-8416-a2cfee248415 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:12.415995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:12.446307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7bdf3d-d3ca-4bd1-8416-a2cfee248415 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:12.480380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:12.480989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:12.481268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:12.481536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:12.482218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:12.482521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:12.483892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:12.491686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 581/1142] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:27:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:12.497655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0a285-9c8a-44f3-8bb5-62c4c24746d2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:12.598794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0a285-9c8a-44f3-8bb5-62c4c24746d2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:12.632375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420e051-2719-4987-bc8a-6560bfed5326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:12.632999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e051-2719-4987-bc8a-6560bfed5326 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:12.633282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e051-2719-4987-bc8a-6560bfed5326 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:12.633560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8420e051-2719-4987-bc8a-6560bfed5326 None admin] PATH_INFO: `/v3/users/8d2e772749ca4bbf992289f5a3a3dcf2` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:12.647037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420e051-2719-4987-bc8a-6560bfed5326 None admin] RBAC: Authorizing `identity:get_user(user_id=8d2e772749ca4bbf992289f5a3a3dcf2)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:12.648473 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8420e051-2719-4987-bc8a-6560bfed5326 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:12.650153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 562/1143] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:12 2022] GET /identity/v3/users/8d2e772749ca4bbf992289f5a3a3dcf2 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:12.656360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:12.755119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c59b2b-0ed1-4f7f-b9da-ebda0c26240a None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:12.788249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667338a-826d-4d38-ab1a-8212b16e411e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:12.788852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667338a-826d-4d38-ab1a-8212b16e411e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:12.789138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667338a-826d-4d38-ab1a-8212b16e411e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:12.789415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8667338a-826d-4d38-ab1a-8212b16e411e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:12.791949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:12.857698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667338a-826d-4d38-ab1a-8212b16e411e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:12.859191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8667338a-826d-4d38-ab1a-8212b16e411e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:12.954778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 582/1144] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:27:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:27:12.960718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420e051-2719-4987-bc8a-6560bfed5326 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:12.985901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:13.060078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8420e051-2719-4987-bc8a-6560bfed5326 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:13.092924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc6ecf7-c893-4c79-a176-ac6bcd253d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:13.093549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6ecf7-c893-4c79-a176-ac6bcd253d0e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:13.093836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6ecf7-c893-4c79-a176-ac6bcd253d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:13.094140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc6ecf7-c893-4c79-a176-ac6bcd253d0e None admin] PATH_INFO: `/v3/projects/c3013ffbab694b8d9cfe178ced43b764` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:13.095583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6ecf7-c893-4c79-a176-ac6bcd253d0e None admin] RBAC: Authorizing `identity:get_project(project_id=c3013ffbab694b8d9cfe178ced43b764)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:13.097032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc6ecf7-c893-4c79-a176-ac6bcd253d0e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:13.098705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 563/1145] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:27:12 2022] GET /identity/v3/projects/c3013ffbab694b8d9cfe178ced43b764 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:13.105609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667338a-826d-4d38-ab1a-8212b16e411e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:13.139213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:13.204819 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8667338a-826d-4d38-ab1a-8212b16e411e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:13.238165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded848a-cd94-4cc0-93ff-e4eb7ef044ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:13.238761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded848a-cd94-4cc0-93ff-e4eb7ef044ac None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:13.239039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded848a-cd94-4cc0-93ff-e4eb7ef044ac None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:13.239306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded848a-cd94-4cc0-93ff-e4eb7ef044ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:13.240019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded848a-cd94-4cc0-93ff-e4eb7ef044ac None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=c3013ffbab694b8d9cfe178ced43b764, user.id=8d2e772749ca4bbf992289f5a3a3dcf2) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:13.240325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded848a-cd94-4cc0-93ff-e4eb7ef044ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:13.241740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ded848a-cd94-4cc0-93ff-e4eb7ef044ac None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:13.247322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 583/1146] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:27:13 2022] GET /identity/v3/role_assignments?user.id=8d2e772749ca4bbf992289f5a3a3dcf2&scope.project.id=c3013ffbab694b8d9cfe178ced43b764&role.id=f21c9b5697b747d39bf8f104797da245 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:15.092980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0f58-2eeb-4771-a653-246cfec4d68e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:15.093550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0f58-2eeb-4771-a653-246cfec4d68e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:15.093550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b0f58-2eeb-4771-a653-246cfec4d68e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:15.094921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 564/1147] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:15.100074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286206-1fef-4ec1-8839-edadcca93c08 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:15.100570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286206-1fef-4ec1-8839-edadcca93c08 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:15.100664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34286206-1fef-4ec1-8839-edadcca93c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:15.118668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-34286206-1fef-4ec1-8839-edadcca93c08 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:15.119880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-34286206-1fef-4ec1-8839-edadcca93c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:15.186336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 584/1148] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:15.461667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b0f58-2eeb-4771-a653-246cfec4d68e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:15.551242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:15.564021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b0f58-2eeb-4771-a653-246cfec4d68e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:15.599279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5646d34-36e2-409f-9a4c-73f62f7e35b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:15.599915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5646d34-36e2-409f-9a4c-73f62f7e35b0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:15.600201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5646d34-36e2-409f-9a4c-73f62f7e35b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:15.600481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5646d34-36e2-409f-9a4c-73f62f7e35b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:15.611090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5646d34-36e2-409f-9a4c-73f62f7e35b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-f5646d34-36e2-409f-9a4c-73f62f7e35b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:27:15.615901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:27:15.617003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:27:15.618017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 565/1149] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:27:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:27:15.623118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34286206-1fef-4ec1-8839-edadcca93c08 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:15.649677 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:15.720405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34286206-1fef-4ec1-8839-edadcca93c08 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:15.754306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:15.754913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:15.755196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:15.755470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:15.756129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:15.756432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:15.757802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:15.766014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 585/1150] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:27:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:15.771965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5646d34-36e2-409f-9a4c-73f62f7e35b0 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:15.872354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5646d34-36e2-409f-9a4c-73f62f7e35b0 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:15.906347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86afd7-3654-456d-8dd1-4fb536a106b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:15.906965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86afd7-3654-456d-8dd1-4fb536a106b6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:15.907250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86afd7-3654-456d-8dd1-4fb536a106b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:15.907529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c86afd7-3654-456d-8dd1-4fb536a106b6 None admin] PATH_INFO: `/v3/users/8d2e772749ca4bbf992289f5a3a3dcf2` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:15.908650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86afd7-3654-456d-8dd1-4fb536a106b6 None admin] RBAC: Authorizing `identity:get_user(user_id=8d2e772749ca4bbf992289f5a3a3dcf2)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:15.910115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c86afd7-3654-456d-8dd1-4fb536a106b6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:15.911755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 566/1151] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:15 2022] GET /identity/v3/users/8d2e772749ca4bbf992289f5a3a3dcf2 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:15.917922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:16.007043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:16.017767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aa8059-ee9b-4579-b1a3-c6e781e381ed None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:16.050412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6898d-d971-4542-aecd-7d97ae3cac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:16.051279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6898d-d971-4542-aecd-7d97ae3cac7d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:16.051558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6898d-d971-4542-aecd-7d97ae3cac7d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:16.051831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6898d-d971-4542-aecd-7d97ae3cac7d None admin] PATH_INFO: `/v3/projects/c3013ffbab694b8d9cfe178ced43b764` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:16.052931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6898d-d971-4542-aecd-7d97ae3cac7d None admin] RBAC: Authorizing `identity:get_project(project_id=c3013ffbab694b8d9cfe178ced43b764)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:16.054410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6898d-d971-4542-aecd-7d97ae3cac7d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:16.056009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 586/1152] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:27:15 2022] GET /identity/v3/projects/c3013ffbab694b8d9cfe178ced43b764 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:16.062246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86afd7-3654-456d-8dd1-4fb536a106b6 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:16.084201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:16.162243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c86afd7-3654-456d-8dd1-4fb536a106b6 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:16.195547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44930b4f-8ef3-41a9-93c2-0438f524cfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:16.196195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930b4f-8ef3-41a9-93c2-0438f524cfe9 None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:16.196480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930b4f-8ef3-41a9-93c2-0438f524cfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:16.196761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44930b4f-8ef3-41a9-93c2-0438f524cfe9 None admin] PATH_INFO: `/v3/projects/c3013ffbab694b8d9cfe178ced43b764/users/8d2e772749ca4bbf992289f5a3a3dcf2/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:16.199474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930b4f-8ef3-41a9-93c2-0438f524cfe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c3013ffbab694b8d9cfe178ced43b764, user_id=8d2e772749ca4bbf992289f5a3a3dcf2, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:16.200905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44930b4f-8ef3-41a9-93c2-0438f524cfe9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:16.213716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 567/1153] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:27:16 2022] PUT /identity/v3/projects/c3013ffbab694b8d9cfe178ced43b764/users/8d2e772749ca4bbf992289f5a3a3dcf2/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:27:18.103307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec51a78-dd17-4664-a421-bef635067b09 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:18.103848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec51a78-dd17-4664-a421-bef635067b09 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:18.103848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec51a78-dd17-4664-a421-bef635067b09 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:18.105320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 587/1154] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:18.110544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c881-91dd-4018-bde5-e084b5f1d2ab None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:18.110952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c881-91dd-4018-bde5-e084b5f1d2ab None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:18.111105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38c881-91dd-4018-bde5-e084b5f1d2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:18.128853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fe38c881-91dd-4018-bde5-e084b5f1d2ab None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:18.130078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fe38c881-91dd-4018-bde5-e084b5f1d2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:18.195978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 568/1155] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:18.466280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec51a78-dd17-4664-a421-bef635067b09 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:18.569126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec51a78-dd17-4664-a421-bef635067b09 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:18.607610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2440abb-d660-418c-b8ce-dbe3b08fe54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:18.608243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440abb-d660-418c-b8ce-dbe3b08fe54c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:18.608527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440abb-d660-418c-b8ce-dbe3b08fe54c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:18.608802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2440abb-d660-418c-b8ce-dbe3b08fe54c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:18.618709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2440abb-d660-418c-b8ce-dbe3b08fe54c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f2440abb-d660-418c-b8ce-dbe3b08fe54c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:27:18.623542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:27:18.624636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:27:18.625510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 588/1156] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:27:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:27:18.630905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38c881-91dd-4018-bde5-e084b5f1d2ab None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:18.642485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:18.733557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe38c881-91dd-4018-bde5-e084b5f1d2ab None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:18.767356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:18.767955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:18.768238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:18.768514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:18.769174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:18.769485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:18.770956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:18.779404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 569/1157] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:27:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:18.785381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2440abb-d660-418c-b8ce-dbe3b08fe54c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:18.809223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:18.890383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2440abb-d660-418c-b8ce-dbe3b08fe54c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:18.923283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099aaeb-d65c-482c-9832-cab5e4bb856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:18.923906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099aaeb-d65c-482c-9832-cab5e4bb856b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:18.924190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099aaeb-d65c-482c-9832-cab5e4bb856b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:18.924469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099aaeb-d65c-482c-9832-cab5e4bb856b None admin] PATH_INFO: `/v3/users/8d2e772749ca4bbf992289f5a3a3dcf2` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:18.925840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099aaeb-d65c-482c-9832-cab5e4bb856b None admin] RBAC: Authorizing `identity:get_user(user_id=8d2e772749ca4bbf992289f5a3a3dcf2)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:18.927329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099aaeb-d65c-482c-9832-cab5e4bb856b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:18.928898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 589/1158] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:18 2022] GET /identity/v3/users/8d2e772749ca4bbf992289f5a3a3dcf2 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:18.934877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:19.003183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:19.032334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f5ceb-09ba-4539-b8dc-47b2a4ecf123 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:19.064279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdd1e9-bc95-4ae0-a9c9-8104de1c5158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:19.064872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdd1e9-bc95-4ae0-a9c9-8104de1c5158 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:19.065150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdd1e9-bc95-4ae0-a9c9-8104de1c5158 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:19.065420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdd1e9-bc95-4ae0-a9c9-8104de1c5158 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:19.129656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdd1e9-bc95-4ae0-a9c9-8104de1c5158 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:19.131128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbdd1e9-bc95-4ae0-a9c9-8104de1c5158 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:19.197749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:19.228207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 570/1159] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:27:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:27:19.234758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099aaeb-d65c-482c-9832-cab5e4bb856b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:19.316839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:19.332125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099aaeb-d65c-482c-9832-cab5e4bb856b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:19.365627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688f655-cd25-4147-8ad1-0a96cb3fe140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:19.366273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f655-cd25-4147-8ad1-0a96cb3fe140 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:19.366554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f655-cd25-4147-8ad1-0a96cb3fe140 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:19.366824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f655-cd25-4147-8ad1-0a96cb3fe140 None admin] PATH_INFO: `/v3/projects/c3013ffbab694b8d9cfe178ced43b764` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:19.367921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688f655-cd25-4147-8ad1-0a96cb3fe140 None admin] RBAC: Authorizing `identity:get_project(project_id=c3013ffbab694b8d9cfe178ced43b764)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:19.369348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688f655-cd25-4147-8ad1-0a96cb3fe140 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:19.371002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 590/1160] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:27:19 2022] GET /identity/v3/projects/c3013ffbab694b8d9cfe178ced43b764 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:19.377141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdd1e9-bc95-4ae0-a9c9-8104de1c5158 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:19.473499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbdd1e9-bc95-4ae0-a9c9-8104de1c5158 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:19.506259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c978fb-a64e-49fb-b208-d76aef8cfddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:19.506841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c978fb-a64e-49fb-b208-d76aef8cfddb None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:19.507120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c978fb-a64e-49fb-b208-d76aef8cfddb None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:19.507391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c978fb-a64e-49fb-b208-d76aef8cfddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:19.508104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c978fb-a64e-49fb-b208-d76aef8cfddb None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=c3013ffbab694b8d9cfe178ced43b764, user.id=8d2e772749ca4bbf992289f5a3a3dcf2) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:19.508411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c978fb-a64e-49fb-b208-d76aef8cfddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:19.509820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c978fb-a64e-49fb-b208-d76aef8cfddb None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:19.515561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 571/1161] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:27:19 2022] GET /identity/v3/role_assignments?user.id=8d2e772749ca4bbf992289f5a3a3dcf2&scope.project.id=c3013ffbab694b8d9cfe178ced43b764&role.id=f21c9b5697b747d39bf8f104797da245 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:21.445722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e60f-0531-44bd-87d4-c62c3dd7512b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:21.446322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e60f-0531-44bd-87d4-c62c3dd7512b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:21.446322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f7e60f-0531-44bd-87d4-c62c3dd7512b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:21.447673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 591/1162] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:21.453444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6d410-1f69-4af8-9153-6b5acfbeba88 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:21.453919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6d410-1f69-4af8-9153-6b5acfbeba88 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:21.454016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6d410-1f69-4af8-9153-6b5acfbeba88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:21.472145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-65c6d410-1f69-4af8-9153-6b5acfbeba88 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:21.473329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-65c6d410-1f69-4af8-9153-6b5acfbeba88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:21.505504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:21.546059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 572/1163] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:21.815709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7e60f-0531-44bd-87d4-c62c3dd7512b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:21.916833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f7e60f-0531-44bd-87d4-c62c3dd7512b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:21.950225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d8e4-7e28-435d-8b3c-e8cd88c75973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:21.950830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d8e4-7e28-435d-8b3c-e8cd88c75973 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:21.951116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d8e4-7e28-435d-8b3c-e8cd88c75973 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:21.951393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4603d8e4-7e28-435d-8b3c-e8cd88c75973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:21.975152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:22.018689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603d8e4-7e28-435d-8b3c-e8cd88c75973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:22.020139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4603d8e4-7e28-435d-8b3c-e8cd88c75973 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:22.117296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 592/1164] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:27:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:27:22.123308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6d410-1f69-4af8-9153-6b5acfbeba88 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:22.220701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6d410-1f69-4af8-9153-6b5acfbeba88 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:22.253501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb628a0-e24c-4e78-87bb-108f4bba9ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:22.254149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb628a0-e24c-4e78-87bb-108f4bba9ca9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:22.254434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb628a0-e24c-4e78-87bb-108f4bba9ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:22.254711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb628a0-e24c-4e78-87bb-108f4bba9ca9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:22.261682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb628a0-e24c-4e78-87bb-108f4bba9ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:22.263154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb628a0-e24c-4e78-87bb-108f4bba9ca9 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-7bb628a0-e24c-4e78-87bb-108f4bba9ca9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:27:22.274302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:27:22.275482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:27:22.276492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 573/1165] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:27:22 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:27:22.281574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d8e4-7e28-435d-8b3c-e8cd88c75973 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:22.336823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:22.380830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4603d8e4-7e28-435d-8b3c-e8cd88c75973 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:22.413968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe67635-7cb6-45dd-b9b0-649efe1a318b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:22.414571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe67635-7cb6-45dd-b9b0-649efe1a318b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:22.414857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe67635-7cb6-45dd-b9b0-649efe1a318b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:22.415137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe67635-7cb6-45dd-b9b0-649efe1a318b None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:22.415776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe67635-7cb6-45dd-b9b0-649efe1a318b None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:22.416084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe67635-7cb6-45dd-b9b0-649efe1a318b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:22.417806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe67635-7cb6-45dd-b9b0-649efe1a318b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:22.424837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 593/1166] 10.222.0.88 () {56 vars in 1115 bytes} [Fri Aug 26 00:27:22 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:24.352653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848893-3c69-433e-8ecb-fc53a53a50d8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:24.353296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848893-3c69-433e-8ecb-fc53a53a50d8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:24.353296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69848893-3c69-433e-8ecb-fc53a53a50d8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:24.355277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 574/1167] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:24.360546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8a425-f7f0-4dbc-be32-7f6b5c9292dd None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:24.360963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8a425-f7f0-4dbc-be32-7f6b5c9292dd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:24.361096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8a425-f7f0-4dbc-be32-7f6b5c9292dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:24.380439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f2c8a425-f7f0-4dbc-be32-7f6b5c9292dd None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:24.381640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f2c8a425-f7f0-4dbc-be32-7f6b5c9292dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:24.448133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 594/1168] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:24.719296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69848893-3c69-433e-8ecb-fc53a53a50d8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:24.748449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:24.828282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69848893-3c69-433e-8ecb-fc53a53a50d8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:24.862665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c79643-549f-444f-a51e-e849d7c8040e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:24.863271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c79643-549f-444f-a51e-e849d7c8040e None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:24.863552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c79643-549f-444f-a51e-e849d7c8040e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:24.863824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c79643-549f-444f-a51e-e849d7c8040e None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:24.864477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c79643-549f-444f-a51e-e849d7c8040e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:24.865844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c79643-549f-444f-a51e-e849d7c8040e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:24.888966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 575/1169] 10.222.0.88 () {60 vars in 1138 bytes} [Fri Aug 26 00:27:24 2022] POST /identity/v3/domains => generated 267 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:27:26.838598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91bd3b-e09d-43f3-9c44-e4e6e9767b3a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:26.839299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91bd3b-e09d-43f3-9c44-e4e6e9767b3a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:26.839299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91bd3b-e09d-43f3-9c44-e4e6e9767b3a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:26.840373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 595/1170] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:26.845659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562031-f495-40fe-a854-259e1a98cf85 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:26.846139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562031-f495-40fe-a854-259e1a98cf85 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:26.846242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de562031-f495-40fe-a854-259e1a98cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:26.864007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-de562031-f495-40fe-a854-259e1a98cf85 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:26.865188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-de562031-f495-40fe-a854-259e1a98cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:26.932675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 576/1171] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:27.200104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91bd3b-e09d-43f3-9c44-e4e6e9767b3a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:27.250796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:27.303728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91bd3b-e09d-43f3-9c44-e4e6e9767b3a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:27.338681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f1779-4a38-486c-becc-1c14d40bb1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:27.339311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1779-4a38-486c-becc-1c14d40bb1b4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:27.339595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1779-4a38-486c-becc-1c14d40bb1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:27.339870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f1779-4a38-486c-becc-1c14d40bb1b4 None admin] PATH_INFO: `/v3/domains/a22b7d61223142f68a2814776af19564` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:27.350178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f1779-4a38-486c-becc-1c14d40bb1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a22b7d61223142f68a2814776af19564)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:27.351641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f1779-4a38-486c-becc-1c14d40bb1b4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:27.353225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 596/1172] 10.222.0.88 () {56 vars in 1183 bytes} [Fri Aug 26 00:27:27 2022] GET /identity/v3/domains/a22b7d61223142f68a2814776af19564 => generated 267 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:27.359991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de562031-f495-40fe-a854-259e1a98cf85 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:27.377854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:27.459113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de562031-f495-40fe-a854-259e1a98cf85 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:27.492889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b8ea7-7f71-44ee-8427-ce6ad3d2c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:27.493487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b8ea7-7f71-44ee-8427-ce6ad3d2c6fd None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:27.493769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b8ea7-7f71-44ee-8427-ce6ad3d2c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:27.494081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b8ea7-7f71-44ee-8427-ce6ad3d2c6fd None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:27.495047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b8ea7-7f71-44ee-8427-ce6ad3d2c6fd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:27.496472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b8ea7-7f71-44ee-8427-ce6ad3d2c6fd None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:27.521942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 577/1173] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:27:27 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:27:29.468048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9bda-6da4-4a6e-9507-bd05886f87d2 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:29.468612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9bda-6da4-4a6e-9507-bd05886f87d2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:29.468612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e9bda-6da4-4a6e-9507-bd05886f87d2 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:29.469936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 597/1174] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:29.475156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e5da-e2d1-439f-a1e4-4b33f9cb3d3a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:29.475545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e5da-e2d1-439f-a1e4-4b33f9cb3d3a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:29.475712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0e5da-e2d1-439f-a1e4-4b33f9cb3d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:29.493744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7dc0e5da-e2d1-439f-a1e4-4b33f9cb3d3a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:29.495084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7dc0e5da-e2d1-439f-a1e4-4b33f9cb3d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:29.554923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:29.560963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 578/1175] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:29.831175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e9bda-6da4-4a6e-9507-bd05886f87d2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:29.933606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e9bda-6da4-4a6e-9507-bd05886f87d2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:29.942678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:29.967630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05296752-74fa-43bd-9439-bfffd93bdba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:29.968249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296752-74fa-43bd-9439-bfffd93bdba1 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:29.968530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296752-74fa-43bd-9439-bfffd93bdba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:29.968805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05296752-74fa-43bd-9439-bfffd93bdba1 None admin] PATH_INFO: `/v3/domains/a22b7d61223142f68a2814776af19564` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:29.969937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05296752-74fa-43bd-9439-bfffd93bdba1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=a22b7d61223142f68a2814776af19564)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:29.971379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05296752-74fa-43bd-9439-bfffd93bdba1 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:29.972946 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 598/1176] 10.222.0.88 () {56 vars in 1183 bytes} [Fri Aug 26 00:27:29 2022] GET /identity/v3/domains/a22b7d61223142f68a2814776af19564 => generated 267 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:29.979106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0e5da-e2d1-439f-a1e4-4b33f9cb3d3a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:30.078035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0e5da-e2d1-439f-a1e4-4b33f9cb3d3a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:30.111413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739508e2-880b-47bf-b8f2-68135542e91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:30.111944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739508e2-880b-47bf-b8f2-68135542e91b None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:30.112229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739508e2-880b-47bf-b8f2-68135542e91b None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:30.112506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739508e2-880b-47bf-b8f2-68135542e91b None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:30.113147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739508e2-880b-47bf-b8f2-68135542e91b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:30.114605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739508e2-880b-47bf-b8f2-68135542e91b None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:30.136467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 579/1177] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:27:29 2022] POST /identity/v3/users => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:27:32.051769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f306d-b064-44ef-b5a4-a72849008b36 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:32.052331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f306d-b064-44ef-b5a4-a72849008b36 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:32.052331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f306d-b064-44ef-b5a4-a72849008b36 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:32.053637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 599/1178] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:32.059208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b128a-9416-4a38-9231-a93b9b5cfc1a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:32.059650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b128a-9416-4a38-9231-a93b9b5cfc1a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:32.059763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b128a-9416-4a38-9231-a93b9b5cfc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:32.077462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c91b128a-9416-4a38-9231-a93b9b5cfc1a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:32.078686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c91b128a-9416-4a38-9231-a93b9b5cfc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:32.127516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:32.145513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 580/1179] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:32.422317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f306d-b064-44ef-b5a4-a72849008b36 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:32.534245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f306d-b064-44ef-b5a4-a72849008b36 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:32.571703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5da086-d2b4-4e8b-a342-ffcd9be00e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:32.572836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5da086-d2b4-4e8b-a342-ffcd9be00e8c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:32.573116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5da086-d2b4-4e8b-a342-ffcd9be00e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:32.573390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5da086-d2b4-4e8b-a342-ffcd9be00e8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:32.583839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5da086-d2b4-4e8b-a342-ffcd9be00e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-3a5da086-d2b4-4e8b-a342-ffcd9be00e8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:27:32.589278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:27:32.590474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:27:32.591792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 600/1180] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:27:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:27:32.596501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b128a-9416-4a38-9231-a93b9b5cfc1a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:32.700929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b128a-9416-4a38-9231-a93b9b5cfc1a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:32.736347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:32.736959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:32.737242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:32.737519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:32.738220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:32.738526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:32.739897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:32.748600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 581/1181] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:27:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:27:32.754466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5da086-d2b4-4e8b-a342-ffcd9be00e8c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:32.789984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:32.857087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5da086-d2b4-4e8b-a342-ffcd9be00e8c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:32.891407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160287a-e3fb-4845-9a36-6c35a5475034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:32.892044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160287a-e3fb-4845-9a36-6c35a5475034 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:32.892330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160287a-e3fb-4845-9a36-6c35a5475034 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:32.892610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e160287a-e3fb-4845-9a36-6c35a5475034 None admin] PATH_INFO: `/v3/users/5a9fd7c7ae054974b13a32d70ce2e1c8` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:32.906482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160287a-e3fb-4845-9a36-6c35a5475034 None admin] RBAC: Authorizing `identity:get_user(user_id=5a9fd7c7ae054974b13a32d70ce2e1c8)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:32.907937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e160287a-e3fb-4845-9a36-6c35a5475034 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:32.909546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 601/1182] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:32 2022] GET /identity/v3/users/5a9fd7c7ae054974b13a32d70ce2e1c8 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:32.915586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:32.965040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:33.018343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d6cf9-f554-470c-9653-2bbb918bd620 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:33.053655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7f424-5b62-45d2-9a83-ecb85cd800a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:33.054300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f424-5b62-45d2-9a83-ecb85cd800a2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:33.054593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f424-5b62-45d2-9a83-ecb85cd800a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:33.054870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7f424-5b62-45d2-9a83-ecb85cd800a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:33.124204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7f424-5b62-45d2-9a83-ecb85cd800a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:33.125662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7f424-5b62-45d2-9a83-ecb85cd800a2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:33.170847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:33.226014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 582/1183] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:27:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:27:33.232034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160287a-e3fb-4845-9a36-6c35a5475034 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:33.323908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:33.331024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e160287a-e3fb-4845-9a36-6c35a5475034 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:33.365716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39e9f3-c463-473d-9007-88c913851926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:33.366366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e9f3-c463-473d-9007-88c913851926 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:33.366648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e9f3-c463-473d-9007-88c913851926 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:33.366922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e9f3-c463-473d-9007-88c913851926 None admin] PATH_INFO: `/v3/projects/bbbd5d812fd8474fa7d8627e52ebb195` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:33.368043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39e9f3-c463-473d-9007-88c913851926 None admin] RBAC: Authorizing `identity:get_project(project_id=bbbd5d812fd8474fa7d8627e52ebb195)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:33.369546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39e9f3-c463-473d-9007-88c913851926 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:33.371217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 602/1184] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:27:33 2022] GET /identity/v3/projects/bbbd5d812fd8474fa7d8627e52ebb195 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:33.377444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7f424-5b62-45d2-9a83-ecb85cd800a2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:33.487895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7f424-5b62-45d2-9a83-ecb85cd800a2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:33.526041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdcd04b-d2bf-4336-a2bb-4e727104481d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:33.526684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcd04b-d2bf-4336-a2bb-4e727104481d None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:33.527112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcd04b-d2bf-4336-a2bb-4e727104481d None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:33.527392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdcd04b-d2bf-4336-a2bb-4e727104481d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:33.528335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcd04b-d2bf-4336-a2bb-4e727104481d None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=bbbd5d812fd8474fa7d8627e52ebb195, user.id=5a9fd7c7ae054974b13a32d70ce2e1c8) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:33.528689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcd04b-d2bf-4336-a2bb-4e727104481d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:33.530261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdcd04b-d2bf-4336-a2bb-4e727104481d None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:33.536206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 583/1185] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:27:33 2022] GET /identity/v3/role_assignments?user.id=5a9fd7c7ae054974b13a32d70ce2e1c8&scope.project.id=bbbd5d812fd8474fa7d8627e52ebb195&role.id=f21c9b5697b747d39bf8f104797da245 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:35.452671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09ff7f-39a3-43e9-8a3b-6eb4e9228cf1 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:35.453233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09ff7f-39a3-43e9-8a3b-6eb4e9228cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:35.453233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a09ff7f-39a3-43e9-8a3b-6eb4e9228cf1 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:35.454570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 603/1186] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:35.459779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0fb2-ee3a-4e5f-a0ec-f7ced179b337 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:35.460206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0fb2-ee3a-4e5f-a0ec-f7ced179b337 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:35.460344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcce0fb2-ee3a-4e5f-a0ec-f7ced179b337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:35.479162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-dcce0fb2-ee3a-4e5f-a0ec-f7ced179b337 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:35.480369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dcce0fb2-ee3a-4e5f-a0ec-f7ced179b337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:35.483141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:35.547712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 584/1187] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:27:35.819333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09ff7f-39a3-43e9-8a3b-6eb4e9228cf1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:35.919095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a09ff7f-39a3-43e9-8a3b-6eb4e9228cf1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:35.953478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f299c8-c0f1-479c-9b3c-20b9056ae742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:35.954127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f299c8-c0f1-479c-9b3c-20b9056ae742 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:35.954411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f299c8-c0f1-479c-9b3c-20b9056ae742 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:35.954691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f299c8-c0f1-479c-9b3c-20b9056ae742 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:35.965558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f299c8-c0f1-479c-9b3c-20b9056ae742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-64f299c8-c0f1-479c-9b3c-20b9056ae742 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:27:35.970335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:27:35.971504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:27:35.972417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 604/1188] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:27:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:27:35.977476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce0fb2-ee3a-4e5f-a0ec-f7ced179b337 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:36.074114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcce0fb2-ee3a-4e5f-a0ec-f7ced179b337 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:36.106656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:36.107278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:36.107558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:36.107830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:36.108487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:36.108788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:36.110203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:36.117919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 585/1189] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:27:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:36.124130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f299c8-c0f1-479c-9b3c-20b9056ae742 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:36.149914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:36.226549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f299c8-c0f1-479c-9b3c-20b9056ae742 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:36.259926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b969536-2294-4452-ade9-12f2bfeb49df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:36.260664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b969536-2294-4452-ade9-12f2bfeb49df None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:36.260953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b969536-2294-4452-ade9-12f2bfeb49df None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:36.261228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b969536-2294-4452-ade9-12f2bfeb49df None admin] PATH_INFO: `/v3/users/5a9fd7c7ae054974b13a32d70ce2e1c8` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:36.262383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b969536-2294-4452-ade9-12f2bfeb49df None admin] RBAC: Authorizing `identity:get_user(user_id=5a9fd7c7ae054974b13a32d70ce2e1c8)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:36.263823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b969536-2294-4452-ade9-12f2bfeb49df None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:36.265398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 605/1190] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:36 2022] GET /identity/v3/users/5a9fd7c7ae054974b13a32d70ce2e1c8 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:36.271348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:36.274185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:36.371356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07df6c4-a76a-468f-8377-ecff273a2642 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:36.404819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f5037e-2a2a-4056-a6cf-85937b2e073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:36.405439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5037e-2a2a-4056-a6cf-85937b2e073c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:36.405722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5037e-2a2a-4056-a6cf-85937b2e073c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:36.406027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5037e-2a2a-4056-a6cf-85937b2e073c None admin] PATH_INFO: `/v3/projects/bbbd5d812fd8474fa7d8627e52ebb195` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:36.407166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5037e-2a2a-4056-a6cf-85937b2e073c None admin] RBAC: Authorizing `identity:get_project(project_id=bbbd5d812fd8474fa7d8627e52ebb195)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:36.408604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f5037e-2a2a-4056-a6cf-85937b2e073c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:36.410261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 586/1191] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:27:36 2022] GET /identity/v3/projects/bbbd5d812fd8474fa7d8627e52ebb195 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:36.416734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b969536-2294-4452-ade9-12f2bfeb49df None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:36.506237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:36.516931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b969536-2294-4452-ade9-12f2bfeb49df None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:36.551406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c53bd-6f10-4aaf-9286-f6cfc99c61ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:36.552061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c53bd-6f10-4aaf-9286-f6cfc99c61ce None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:36.552350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c53bd-6f10-4aaf-9286-f6cfc99c61ce None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:36.552635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c53bd-6f10-4aaf-9286-f6cfc99c61ce None admin] PATH_INFO: `/v3/projects/bbbd5d812fd8474fa7d8627e52ebb195/users/5a9fd7c7ae054974b13a32d70ce2e1c8/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:36.554590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c53bd-6f10-4aaf-9286-f6cfc99c61ce None admin] RBAC: Authorizing `identity:create_grant(project_id=bbbd5d812fd8474fa7d8627e52ebb195, user_id=5a9fd7c7ae054974b13a32d70ce2e1c8, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:36.557270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c53bd-6f10-4aaf-9286-f6cfc99c61ce None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:36.570129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 606/1192] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:27:36 2022] PUT /identity/v3/projects/bbbd5d812fd8474fa7d8627e52ebb195/users/5a9fd7c7ae054974b13a32d70ce2e1c8/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:27:38.459312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e467da3-88d6-4b0c-ac66-6d45b0326996 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:38.459889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e467da3-88d6-4b0c-ac66-6d45b0326996 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:38.459889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e467da3-88d6-4b0c-ac66-6d45b0326996 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:38.461200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 587/1193] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:27:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:27:38.467287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e409e5-4f05-405a-a9cd-c25289fbb821 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:38.467701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e409e5-4f05-405a-a9cd-c25289fbb821 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:38.467836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e409e5-4f05-405a-a9cd-c25289fbb821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:38.485444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-91e409e5-4f05-405a-a9cd-c25289fbb821 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:27:38.486656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-91e409e5-4f05-405a-a9cd-c25289fbb821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:27:38.550364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 607/1194] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:27:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:27:38.814784 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e467da3-88d6-4b0c-ac66-6d45b0326996 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:38.885241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:38.916343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e467da3-88d6-4b0c-ac66-6d45b0326996 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:38.950305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3f683-2135-4d9f-9439-3ef5bc4d79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:38.950922 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3f683-2135-4d9f-9439-3ef5bc4d79f8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:38.951204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3f683-2135-4d9f-9439-3ef5bc4d79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:38.951477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3f683-2135-4d9f-9439-3ef5bc4d79f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:38.961393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3f683-2135-4d9f-9439-3ef5bc4d79f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d3f3f683-2135-4d9f-9439-3ef5bc4d79f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:27:38.966485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:27:38.967599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:27:38.968703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 588/1195] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:27:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:27:38.973575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e409e5-4f05-405a-a9cd-c25289fbb821 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:39.051793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:39.072480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e409e5-4f05-405a-a9cd-c25289fbb821 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:39.105356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:39.105971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:39.106252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:39.106524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:39.107178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:39.107478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:39.108837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:39.116620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 608/1196] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:27:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:39.123154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3f683-2135-4d9f-9439-3ef5bc4d79f8 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:39.220822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3f683-2135-4d9f-9439-3ef5bc4d79f8 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:39.249187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:39.255135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2b94-8458-4a42-a495-0b0e96a3822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:39.255757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2b94-8458-4a42-a495-0b0e96a3822e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:39.256039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2b94-8458-4a42-a495-0b0e96a3822e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:39.256313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc2b94-8458-4a42-a495-0b0e96a3822e None admin] PATH_INFO: `/v3/users/5a9fd7c7ae054974b13a32d70ce2e1c8` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:39.257421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc2b94-8458-4a42-a495-0b0e96a3822e None admin] RBAC: Authorizing `identity:get_user(user_id=5a9fd7c7ae054974b13a32d70ce2e1c8)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:39.258875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc2b94-8458-4a42-a495-0b0e96a3822e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:39.260490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 589/1197] 10.222.0.88 () {56 vars in 1177 bytes} [Fri Aug 26 00:27:39 2022] GET /identity/v3/users/5a9fd7c7ae054974b13a32d70ce2e1c8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:39.266638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:39.366660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3eb714-3b04-49eb-9c85-43f6a3857718 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:39.399697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546efe2-dcf1-4e90-9e37-00ebd1293f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:39.400638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546efe2-dcf1-4e90-9e37-00ebd1293f73 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:39.400929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546efe2-dcf1-4e90-9e37-00ebd1293f73 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:39.401210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546efe2-dcf1-4e90-9e37-00ebd1293f73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:39.413051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:39.470672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546efe2-dcf1-4e90-9e37-00ebd1293f73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:39.472128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546efe2-dcf1-4e90-9e37-00ebd1293f73 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:39.575496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 609/1198] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:27:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:27:39.581307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2b94-8458-4a42-a495-0b0e96a3822e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:39.678789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc2b94-8458-4a42-a495-0b0e96a3822e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:39.711202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179ab7-ff4f-45be-87f2-4a98631f42ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:39.711814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179ab7-ff4f-45be-87f2-4a98631f42ce None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:39.712096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179ab7-ff4f-45be-87f2-4a98631f42ce None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:39.712899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179ab7-ff4f-45be-87f2-4a98631f42ce None admin] PATH_INFO: `/v3/projects/bbbd5d812fd8474fa7d8627e52ebb195` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:39.714092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc179ab7-ff4f-45be-87f2-4a98631f42ce None admin] RBAC: Authorizing `identity:get_project(project_id=bbbd5d812fd8474fa7d8627e52ebb195)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:39.716804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc179ab7-ff4f-45be-87f2-4a98631f42ce None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:39.718451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 590/1199] 10.222.0.88 () {56 vars in 1186 bytes} [Fri Aug 26 00:27:39 2022] GET /identity/v3/projects/bbbd5d812fd8474fa7d8627e52ebb195 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:39.724535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546efe2-dcf1-4e90-9e37-00ebd1293f73 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:27:39.766026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:39.823979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546efe2-dcf1-4e90-9e37-00ebd1293f73 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:27:39.856916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c12eefa-b37c-4cc8-8df6-e5d50639bd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:27:39.857508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12eefa-b37c-4cc8-8df6-e5d50639bd95 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:27:39.857787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12eefa-b37c-4cc8-8df6-e5d50639bd95 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:27:39.858084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c12eefa-b37c-4cc8-8df6-e5d50639bd95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:27:39.858797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12eefa-b37c-4cc8-8df6-e5d50639bd95 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=bbbd5d812fd8474fa7d8627e52ebb195, user.id=5a9fd7c7ae054974b13a32d70ce2e1c8) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:27:39.859107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12eefa-b37c-4cc8-8df6-e5d50639bd95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:27:39.860530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c12eefa-b37c-4cc8-8df6-e5d50639bd95 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:27:39.867087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 610/1200] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:27:39 2022] GET /identity/v3/role_assignments?user.id=5a9fd7c7ae054974b13a32d70ce2e1c8&scope.project.id=bbbd5d812fd8474fa7d8627e52ebb195&role.id=f21c9b5697b747d39bf8f104797da245 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:27:49.707191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=67 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:27:49.863650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=47 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:37.045539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a393b-2970-4879-827e-29e5519f5fee None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:37.046183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a393b-2970-4879-827e-29e5519f5fee None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:37.046183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a393b-2970-4879-827e-29e5519f5fee None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:37.048016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 591/1201] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:28:37.055438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1f40-959f-4f81-b551-5039dfe0483f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:37.055976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1f40-959f-4f81-b551-5039dfe0483f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:37.055976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a1f40-959f-4f81-b551-5039dfe0483f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:37.080026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-465a1f40-959f-4f81-b551-5039dfe0483f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:28:37.081533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-465a1f40-959f-4f81-b551-5039dfe0483f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:28:37.193632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 611/1202] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:28:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:28:37.577566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a393b-2970-4879-827e-29e5519f5fee None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:37.727130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a393b-2970-4879-827e-29e5519f5fee None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:37.796603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:37.797856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:37.798170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:37.798464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:37.820680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:37.822900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:37.848392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:37.850287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:37.856833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:37.856833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:37.856833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:37.856833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 592/1203] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:37.858706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a1f40-959f-4f81-b551-5039dfe0483f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:38.017966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a1f40-959f-4f81-b551-5039dfe0483f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:38.073589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:38.082262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543cadd-fdcf-4449-9c9b-4516359a44f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:38.082919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543cadd-fdcf-4449-9c9b-4516359a44f9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:38.083205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543cadd-fdcf-4449-9c9b-4516359a44f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:38.084059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543cadd-fdcf-4449-9c9b-4516359a44f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:38.085116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543cadd-fdcf-4449-9c9b-4516359a44f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:38.085430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543cadd-fdcf-4449-9c9b-4516359a44f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:38.086870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543cadd-fdcf-4449-9c9b-4516359a44f9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:38.102809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 612/1204] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:38.108970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:38.179654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:38.247042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc26b35-7331-475e-9c72-679dc0b01eac None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:38.285738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89aa147-ba58-4947-89dc-50d547abe5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:38.286862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa147-ba58-4947-89dc-50d547abe5fc None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:38.287210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa147-ba58-4947-89dc-50d547abe5fc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:38.287620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89aa147-ba58-4947-89dc-50d547abe5fc None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:38.288308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aa147-ba58-4947-89dc-50d547abe5fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:38.289840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89aa147-ba58-4947-89dc-50d547abe5fc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:38.322602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 593/1205] 10.222.0.88 () {60 vars in 1132 bytes} [Fri Aug 26 00:28:38 2022] POST /identity/v3/users => generated 251 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:28:41.039708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcce12-1dba-4cf1-9439-8651eb5224ff None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:41.040352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcce12-1dba-4cf1-9439-8651eb5224ff None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:41.040352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fcce12-1dba-4cf1-9439-8651eb5224ff None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:41.041687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 613/1206] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:28:41.048606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ad92-99ce-43b8-887a-4a59cefadc59 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:41.049341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ad92-99ce-43b8-887a-4a59cefadc59 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:41.049341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929ad92-99ce-43b8-887a-4a59cefadc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:41.070089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5929ad92-99ce-43b8-887a-4a59cefadc59 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:28:41.071553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5929ad92-99ce-43b8-887a-4a59cefadc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:28:41.157920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 594/1207] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:28:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:28:41.445353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcce12-1dba-4cf1-9439-8651eb5224ff None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:41.605151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fcce12-1dba-4cf1-9439-8651eb5224ff None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:41.656020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c487-f46d-410d-a4f7-c13c7111d1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:41.657173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c487-f46d-410d-a4f7-c13c7111d1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:41.657898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c487-f46d-410d-a4f7-c13c7111d1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:41.658365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c487-f46d-410d-a4f7-c13c7111d1c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:41.673492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9c487-f46d-410d-a4f7-c13c7111d1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-cce9c487-f46d-410d-a4f7-c13c7111d1c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:28:41.680929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:41.687533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:41.688709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 614/1208] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:28:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:41.689510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ad92-99ce-43b8-887a-4a59cefadc59 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:41.757405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:41.869641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929ad92-99ce-43b8-887a-4a59cefadc59 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:41.917759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:41.919050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:41.919702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:41.920258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:41.921981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:41.924755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:41.926690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:41.947722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 595/1209] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:28:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:41.949638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c487-f46d-410d-a4f7-c13c7111d1c8 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:42.027916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:42.107352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c487-f46d-410d-a4f7-c13c7111d1c8 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:42.174330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:42.176635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:42.176635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:42.176635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:42.194823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:42.197454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:42.221845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:42.223032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:42.229600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:42.229600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:42.229600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:42.229600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 615/1210] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:42.231005 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:42.418056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:42.422587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fdd36-1474-4a38-9575-4acda94a42dc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:42.477354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:42.478065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:42.478360 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:42.478605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:42.479240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:42.479542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:42.480941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:42.495881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 596/1211] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:42.505512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:42.703780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc41420-c65f-4541-8970-305b3291d07f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:42.707070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:42.766812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:42.767730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:42.768232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:42.769038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:42.787034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:42.788799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:28:42.809050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:42.816749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:42.818959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 616/1212] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:42.820164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:43.012229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9af0d2-b642-4395-a790-3fa58d0704df None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:43.060271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:43.061012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:43.061496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:43.061814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:43.062724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:43.065122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:43.066765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:43.113517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 597/1213] 10.222.0.88 () {56 vars in 1143 bytes} [Fri Aug 26 00:28:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:28:43.116102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:43.274209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148930b6-2f5a-4726-b6b5-e0600c5c331e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:43.320825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b409f6a-beb6-45cf-b46f-5844e9509bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:43.321591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b409f6a-beb6-45cf-b46f-5844e9509bdc None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:43.322121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b409f6a-beb6-45cf-b46f-5844e9509bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:43.323828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b409f6a-beb6-45cf-b46f-5844e9509bdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:43.371914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:43.421834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b409f6a-beb6-45cf-b46f-5844e9509bdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:43.423509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b409f6a-beb6-45cf-b46f-5844e9509bdc None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:43.578796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 617/1214] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:28:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:28:43.586888 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:43.624611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:43.750608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa8c7b-1941-4888-a1b2-25c4dfcc88ec None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:43.809563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:43.810725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:43.811647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:43.812004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:43.829524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:43.831778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:43.855626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:43.857943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:43.860002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:43.860002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:43.860002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:43.867121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 598/1215] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:28:43.867375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b409f6a-beb6-45cf-b46f-5844e9509bdc None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:43.969624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:44.042168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b409f6a-beb6-45cf-b46f-5844e9509bdc None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:44.109639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:44.109639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:44.109639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:44.109639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:44.110426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:44.110426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:44.111845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:44.126757 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 618/1216] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:44.136064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:44.234309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:44.274422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d88650-7be9-423f-bc00-48385579fb8e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:44.316853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:44.317593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:44.317934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:44.318202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:44.327554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:44.329026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:28:44.342300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:44.343701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:44.344708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 599/1217] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:28:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:44.350795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:44.470571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b85437-f6f9-489e-ae0a-815fae74864f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:44.504439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:44.518464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc68fe2-98d1-4dec-a09a-7f0fae5ac223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:44.519081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68fe2-98d1-4dec-a09a-7f0fae5ac223 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:44.519364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68fe2-98d1-4dec-a09a-7f0fae5ac223 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:44.519638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc68fe2-98d1-4dec-a09a-7f0fae5ac223 None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:44.520343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc68fe2-98d1-4dec-a09a-7f0fae5ac223 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:44.520749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc68fe2-98d1-4dec-a09a-7f0fae5ac223 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:44.522234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc68fe2-98d1-4dec-a09a-7f0fae5ac223 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:44.535908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 619/1218] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:28:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:44.542698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:44.669056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7dc8d2-2978-4969-909c-ffb78e5497f2 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:44.702697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:44.710688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c8aaf-5214-4d6d-9d22-718e6fb976e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:44.711303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c8aaf-5214-4d6d-9d22-718e6fb976e1 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:44.711588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c8aaf-5214-4d6d-9d22-718e6fb976e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:44.711881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c8aaf-5214-4d6d-9d22-718e6fb976e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:44.713027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c8aaf-5214-4d6d-9d22-718e6fb976e1 None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=07c06e04bd894c57a035e01e92610a98) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:44.713027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c8aaf-5214-4d6d-9d22-718e6fb976e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:44.714765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c8aaf-5214-4d6d-9d22-718e6fb976e1 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:44.730001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 600/1219] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:28:44 2022] GET /identity/v3/role_assignments?user.id=07c06e04bd894c57a035e01e92610a98&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:46.858811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2327-e789-44cd-92b7-5a2cf4c45e04 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:46.859603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2327-e789-44cd-92b7-5a2cf4c45e04 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:46.859603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2d2327-e789-44cd-92b7-5a2cf4c45e04 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:46.860811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 620/1220] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:28:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:28:46.867509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e0db-4a96-44b5-aeb9-0cdc04187767 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:46.868024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e0db-4a96-44b5-aeb9-0cdc04187767 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:46.868117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5063e0db-4a96-44b5-aeb9-0cdc04187767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:46.888243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5063e0db-4a96-44b5-aeb9-0cdc04187767 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:28:46.889555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5063e0db-4a96-44b5-aeb9-0cdc04187767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:28:46.978339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 601/1221] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:28:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:28:47.256629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d2327-e789-44cd-92b7-5a2cf4c45e04 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:47.382390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2d2327-e789-44cd-92b7-5a2cf4c45e04 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:47.425756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014a6d8-c758-4aee-b7c9-928693101961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:47.426539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014a6d8-c758-4aee-b7c9-928693101961 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:47.426841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014a6d8-c758-4aee-b7c9-928693101961 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:47.427122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014a6d8-c758-4aee-b7c9-928693101961 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:47.438672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014a6d8-c758-4aee-b7c9-928693101961 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0014a6d8-c758-4aee-b7c9-928693101961 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:28:47.445559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:47.446664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:47.447583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 621/1222] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:28:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:47.453563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063e0db-4a96-44b5-aeb9-0cdc04187767 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:47.571278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5063e0db-4a96-44b5-aeb9-0cdc04187767 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:47.617517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:47.635308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:47.635925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:47.636205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:47.636478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:47.637152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:47.637452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:47.638861 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:47.648454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 602/1223] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:28:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:47.654977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014a6d8-c758-4aee-b7c9-928693101961 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:47.715006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:47.783107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014a6d8-c758-4aee-b7c9-928693101961 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:47.831438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:47.832349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:47.832918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:47.833399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:47.845948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:47.847407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:47.870784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:47.877709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:47.878827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:47.878827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:47.878827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:47.878827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 622/1224] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:47.879126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:48.004824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e66ba-1801-4713-8c59-2b8cc8236f78 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:48.050915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:48.052096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:48.052394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:48.052658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:48.053329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:48.053632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:48.055046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:48.075427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 603/1225] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:48.081601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:48.204544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:48.212844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ea90-2274-489c-af12-54e530d5af84 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:48.261313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:48.262345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:48.262691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:48.263054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:48.273231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:48.275371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:28:48.294289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:48.295516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:48.296820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 623/1226] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:48.303002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:48.370303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:48.434892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebca3da-9ac4-483e-a748-69ff3174b3ce None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:48.479957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:48.480617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:48.480940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:48.481241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:48.482164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:48.482526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:48.484001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:48.506492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 604/1227] 10.222.0.88 () {56 vars in 1143 bytes} [Fri Aug 26 00:28:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:48.512304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:48.653341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145c8127-331c-49ac-9b41-ea9e4d33f04b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:48.699725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:48.700437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:48.700781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:48.701065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:48.714952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:48.716756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:48.740255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:48.741714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:48.742730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:48.742730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:48.742730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:48.742730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 624/1228] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:28:48.748385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:48.906060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca6742-f2d2-463f-9764-65070b97df31 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:48.911470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:48.961628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:48.962300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:48.962593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:48.962875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:48.963540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:48.963846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:48.965239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:48.984424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 605/1229] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:28:48.993637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:49.008954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:49.121620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd76663-239c-43f6-b0a7-9b312fca473e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:49.160026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:49.160579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:49.161694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:49.161994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:49.169674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:49.171431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:28:49.182840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:49.185090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:49.187191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:28:49.187191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:28:49.187191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:28:49.187191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:28:49.187191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:28:49.187191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:28:49.187191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:28:49.187191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:49.189504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 625/1230] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:28:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:49.190693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:49.313093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a059ab89-2cf1-4282-bc9c-a514d828add5 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:49.363273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ce2e3-353e-41b5-813d-6d87b08012a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:49.363944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce2e3-353e-41b5-813d-6d87b08012a8 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:49.364415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce2e3-353e-41b5-813d-6d87b08012a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:49.364898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ce2e3-353e-41b5-813d-6d87b08012a8 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:49.365621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ce2e3-353e-41b5-813d-6d87b08012a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:49.365964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ce2e3-353e-41b5-813d-6d87b08012a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:49.367426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ce2e3-353e-41b5-813d-6d87b08012a8 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:49.382325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 606/1231] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:28:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:28:49.389084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:49.474583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:49.517908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432f046-ef5e-47e5-9731-5b2247ce9822 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:49.559881 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a58c4e-ef74-43ba-926e-453da0c793fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:49.560761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a58c4e-ef74-43ba-926e-453da0c793fa None admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:49.561048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a58c4e-ef74-43ba-926e-453da0c793fa None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:49.561328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a58c4e-ef74-43ba-926e-453da0c793fa None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/07c06e04bd894c57a035e01e92610a98/roles/b488fca06c5144f48db762c7a2ab776b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:49.588817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a58c4e-ef74-43ba-926e-453da0c793fa None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=07c06e04bd894c57a035e01e92610a98, role_id=b488fca06c5144f48db762c7a2ab776b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:49.590510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a58c4e-ef74-43ba-926e-453da0c793fa None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:49.605160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 626/1232] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:28:49 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/07c06e04bd894c57a035e01e92610a98/roles/b488fca06c5144f48db762c7a2ab776b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:28:51.603376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2cd5f-bc20-4127-9a75-3f431a955fc1 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:51.603959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2cd5f-bc20-4127-9a75-3f431a955fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:51.603959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae2cd5f-bc20-4127-9a75-3f431a955fc1 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:51.605269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 607/1233] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:28:51.611021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29805cc8-4b34-41ed-bfc3-c819accf6934 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:51.611642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29805cc8-4b34-41ed-bfc3-c819accf6934 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:51.611642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29805cc8-4b34-41ed-bfc3-c819accf6934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:51.630085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-29805cc8-4b34-41ed-bfc3-c819accf6934 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:28:51.631288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-29805cc8-4b34-41ed-bfc3-c819accf6934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:28:51.703651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 627/1234] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:28:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:28:51.983474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2cd5f-bc20-4127-9a75-3f431a955fc1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:52.015857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:52.100078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae2cd5f-bc20-4127-9a75-3f431a955fc1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:52.139302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089720a-7dd2-420c-8ec4-20b842e61207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:52.140042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089720a-7dd2-420c-8ec4-20b842e61207 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:52.140336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089720a-7dd2-420c-8ec4-20b842e61207 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:52.140686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089720a-7dd2-420c-8ec4-20b842e61207 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:52.154937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089720a-7dd2-420c-8ec4-20b842e61207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-a089720a-7dd2-420c-8ec4-20b842e61207 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:28:52.159669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:52.161309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 26 00:28:52.162588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:52.166524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 608/1235] 10.222.0.88 () {56 vars in 1102 bytes} [Fri Aug 26 00:28:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:52.167728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29805cc8-4b34-41ed-bfc3-c819accf6934 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:52.239240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:52.310035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29805cc8-4b34-41ed-bfc3-c819accf6934 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:52.350741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:52.351421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:52.351708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:52.352031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:52.352737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] RBAC: Adding query filter params (name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:52.353039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:52.354606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:52.364145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 628/1236] 10.222.0.88 () {56 vars in 1103 bytes} [Fri Aug 26 00:28:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:52.369913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089720a-7dd2-420c-8ec4-20b842e61207 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:52.465930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:52.484099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089720a-7dd2-420c-8ec4-20b842e61207 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:52.523324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:52.523877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:52.524244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:52.524424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:52.536631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:52.538127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:52.560738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:52.567138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:52.568611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:52.568611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:52.568611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:52.568611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 609/1237] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:52.568915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:52.699772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0eb9e7-e84d-4ec8-bed2-823ee35e800c None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:52.712934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:52.748168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:52.748979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:52.749439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:52.749678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:52.750883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:52.751712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:52.753421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:52.771687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 629/1238] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:52.777834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:52.908848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789255a-7508-4926-81d5-86a6fb6b7d55 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:52.958202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:52.958804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:52.959089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:52.959356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:52.962971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:52.968935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:52.970444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:28:52.983463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:52.984729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:28:52.986060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:52.987762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 610/1239] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:52.994283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:53.124420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdcc3f-150b-450a-a86d-c88b21ca2bbd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:53.166271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:53.166922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:53.167204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:53.167487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:53.168325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:53.168681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:53.170303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:53.192309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 630/1240] 10.222.0.88 () {56 vars in 1143 bytes} [Fri Aug 26 00:28:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:28:53.199003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:53.330438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f321c7-59a9-427b-8256-f45249ed5565 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:53.367781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2579c7-d18c-40b1-9f03-05a5825c2690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:53.368387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2579c7-d18c-40b1-9f03-05a5825c2690 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:53.368668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2579c7-d18c-40b1-9f03-05a5825c2690 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:53.368940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2579c7-d18c-40b1-9f03-05a5825c2690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:53.439426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:53.446614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2579c7-d18c-40b1-9f03-05a5825c2690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:53.448067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2579c7-d18c-40b1-9f03-05a5825c2690 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:53.565334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 611/1241] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:28:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:28:53.571741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:53.604300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:53.688764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b08b59-06ca-4aa4-a4be-6d5997a3aa37 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:53.732500 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:53.733155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:53.733473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:53.733712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:53.745454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:53.747044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:53.763683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:53.764883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:53.765919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:53.765919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:53.765919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:53.765919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 631/1242] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:53.771876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2579c7-d18c-40b1-9f03-05a5825c2690 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:53.894015 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:53.905666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2579c7-d18c-40b1-9f03-05a5825c2690 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:53.949987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:53.950805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:53.951177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:53.951599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:53.952530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:53.952936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:53.954788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:53.968004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 612/1243] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:53.974215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:54.080223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:54.106735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fe5e40-ed84-493a-9817-89cdc27dd536 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:54.155761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:54.156438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:54.156736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:54.157108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:54.166046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:54.167657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:28:54.181723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:54.182727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:54.184077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 632/1244] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:28:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:54.188909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:54.316974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533bf2e-fe11-42e5-83bf-3d031236ff20 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:54.359099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61a16b-d841-417d-b089-116e01a3840f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:54.359630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a16b-d841-417d-b089-116e01a3840f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:54.359912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a16b-d841-417d-b089-116e01a3840f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:54.360181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61a16b-d841-417d-b089-116e01a3840f None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:54.360937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61a16b-d841-417d-b089-116e01a3840f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:54.361240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61a16b-d841-417d-b089-116e01a3840f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:54.362727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61a16b-d841-417d-b089-116e01a3840f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:54.377851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 613/1245] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:28:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:54.384695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:54.525483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df5850-9fbb-4d69-9722-1c74e04fd24f None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:54.573440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79fd91-2cf5-4ad9-a82e-791a8c71f43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:54.574128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79fd91-2cf5-4ad9-a82e-791a8c71f43d None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:54.574422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79fd91-2cf5-4ad9-a82e-791a8c71f43d None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:54.574733 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79fd91-2cf5-4ad9-a82e-791a8c71f43d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:54.575720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79fd91-2cf5-4ad9-a82e-791a8c71f43d None admin] RBAC: Adding query filter params (role.id=b488fca06c5144f48db762c7a2ab776b, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=07c06e04bd894c57a035e01e92610a98) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:54.576164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79fd91-2cf5-4ad9-a82e-791a8c71f43d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:54.577979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79fd91-2cf5-4ad9-a82e-791a8c71f43d None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:54.586136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 633/1246] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:28:54 2022] GET /identity/v3/role_assignments?user.id=07c06e04bd894c57a035e01e92610a98&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=b488fca06c5144f48db762c7a2ab776b => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:56.604133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342611-5854-4b9d-90c8-ea08958d7cd8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:56.604877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342611-5854-4b9d-90c8-ea08958d7cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:56.604877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70342611-5854-4b9d-90c8-ea08958d7cd8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:56.606123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 614/1247] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:28:56.611838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4513-688a-4117-af5c-534f3cd78b94 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:56.612544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4513-688a-4117-af5c-534f3cd78b94 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:56.612544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f4513-688a-4117-af5c-534f3cd78b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:56.620662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:56.636086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3f9f4513-688a-4117-af5c-534f3cd78b94 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:28:56.637599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3f9f4513-688a-4117-af5c-534f3cd78b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:28:56.722206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 634/1248] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:28:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:28:57.028125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70342611-5854-4b9d-90c8-ea08958d7cd8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:57.050061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:57.167758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70342611-5854-4b9d-90c8-ea08958d7cd8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:57.217987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4610-54ed-4d93-acd1-914a4aca44d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:57.218518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4610-54ed-4d93-acd1-914a4aca44d9 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:57.218910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4610-54ed-4d93-acd1-914a4aca44d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:57.219068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f4610-54ed-4d93-acd1-914a4aca44d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:57.230131 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f4610-54ed-4d93-acd1-914a4aca44d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-d61f4610-54ed-4d93-acd1-914a4aca44d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:28:57.234986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:57.236231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:57.237342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 615/1249] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:28:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:57.242444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f4513-688a-4117-af5c-534f3cd78b94 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:57.362089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f4513-688a-4117-af5c-534f3cd78b94 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:57.399212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:57.407904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:57.408610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:57.408905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:57.409207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:57.410198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:57.410543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:57.412414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:57.426746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 635/1250] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:28:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:28:57.432793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4610-54ed-4d93-acd1-914a4aca44d9 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:57.559853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:57.593679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f4610-54ed-4d93-acd1-914a4aca44d9 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:57.639812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:57.640574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:57.641045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:57.641045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:57.652584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:57.654087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:57.673466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:57.674587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:57.676392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:57.676392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:57.676392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:57.676392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 616/1251] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:57.681564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:57.816836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee89b42-9c41-4e26-b061-0bf11f0f69ff None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:57.865668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:57.866383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:57.866650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:57.866941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:57.867530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:57.867934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:57.869269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:57.883537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 636/1252] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:57.889503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:58.040388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febf15d0-9c7d-468d-8b89-1db8207ffb4e None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:58.073301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:58.081774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:58.083123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:58.083485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:58.083764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:58.092471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:58.093972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:28:58.106413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:58.107803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:28:58.109350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 617/1253] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:58.113828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:58.183631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:58.233020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391d983d-cb63-489e-a3a0-76a54ab8f986 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:58.275240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:58.275868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:58.276194 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:58.276519 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:58.277305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:58.277617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:58.279100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:58.298019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 637/1254] 10.222.0.88 () {56 vars in 1143 bytes} [Fri Aug 26 00:28:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:58.304762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:58.429590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53fddb9-854e-4ec4-8c0c-664c186efdd4 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:58.466981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95f3d0-f507-4471-aac8-84bdb2fa4452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:58.467585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95f3d0-f507-4471-aac8-84bdb2fa4452 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:58.467863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95f3d0-f507-4471-aac8-84bdb2fa4452 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:58.468133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d95f3d0-f507-4471-aac8-84bdb2fa4452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:58.534537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:58.552609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95f3d0-f507-4471-aac8-84bdb2fa4452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:58.554096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d95f3d0-f507-4471-aac8-84bdb2fa4452 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:58.679160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 618/1255] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:28:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 26 00:28:58.684916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:58.798175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6c973-298a-4a2b-b477-53d20d658fa4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:58.814787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:58.842039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:58.842774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:58.843061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:58.843333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:58.855524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:58.857019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:28:58.880607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:58.882089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:28:58.883057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:28:58.883057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:28:58.883057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:58.883057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 638/1256] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:58.890030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95f3d0-f507-4471-aac8-84bdb2fa4452 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:58.987656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:59.000918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d95f3d0-f507-4471-aac8-84bdb2fa4452 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:59.045959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:59.046842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:59.047168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:59.047491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:59.048161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:59.048554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:59.050201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:59.064548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 619/1257] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:59.070658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:59.199613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10604bc0-0736-489e-bedb-a172d0d87fb9 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:59.256622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:59.257650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:59.258163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:59.258635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:59.268108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:59.270242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:28:59.283065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:28:59.284248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:28:59.285746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 639/1258] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:28:59.290269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:59.415496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001d5c7-dbe4-49a3-99ab-817beda9c666 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:59.454115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9bbe5-512a-4b28-a0fb-dc53ae02f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:59.454724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9bbe5-512a-4b28-a0fb-dc53ae02f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:59.455006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9bbe5-512a-4b28-a0fb-dc53ae02f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:59.455281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9bbe5-512a-4b28-a0fb-dc53ae02f4d6 None admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:59.455987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9bbe5-512a-4b28-a0fb-dc53ae02f4d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:59.456293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9bbe5-512a-4b28-a0fb-dc53ae02f4d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:59.458149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9bbe5-512a-4b28-a0fb-dc53ae02f4d6 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:59.471155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 620/1259] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:28:59.478397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:28:59.513347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:28:59.611690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007831b-1b54-4e6d-bf8b-abf597f344dd None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:28:59.652913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e021a3-dd31-4646-896d-6ebfd7c6d446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:28:59.653870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e021a3-dd31-4646-896d-6ebfd7c6d446 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:28:59.654367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e021a3-dd31-4646-896d-6ebfd7c6d446 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:28:59.654808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e021a3-dd31-4646-896d-6ebfd7c6d446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:28:59.656104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e021a3-dd31-4646-896d-6ebfd7c6d446 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=07c06e04bd894c57a035e01e92610a98) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:28:59.656639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e021a3-dd31-4646-896d-6ebfd7c6d446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:28:59.659054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e021a3-dd31-4646-896d-6ebfd7c6d446 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:28:59.665769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 640/1260] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:28:59 2022] GET /identity/v3/role_assignments?user.id=07c06e04bd894c57a035e01e92610a98&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=f21c9b5697b747d39bf8f104797da245 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:01.662304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74e9c-1a52-420c-a94b-9cbe70605fdf None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:01.662824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74e9c-1a52-420c-a94b-9cbe70605fdf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:01.662948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada74e9c-1a52-420c-a94b-9cbe70605fdf None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:01.664193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 621/1261] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:29:01.669316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95aedb-ff5a-4c74-8545-f423424b1d1c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:01.669741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95aedb-ff5a-4c74-8545-f423424b1d1c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:01.669887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95aedb-ff5a-4c74-8545-f423424b1d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:01.689227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fe95aedb-ff5a-4c74-8545-f423424b1d1c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:29:01.690452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fe95aedb-ff5a-4c74-8545-f423424b1d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:29:01.755593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 641/1262] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:29:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:29:02.029681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada74e9c-1a52-420c-a94b-9cbe70605fdf None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:02.041362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:02.128083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada74e9c-1a52-420c-a94b-9cbe70605fdf None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:02.161029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c1cd-57c3-4e12-aaa0-1c7bb984f286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:02.161644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c1cd-57c3-4e12-aaa0-1c7bb984f286 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:02.161948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c1cd-57c3-4e12-aaa0-1c7bb984f286 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:02.162222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807c1cd-57c3-4e12-aaa0-1c7bb984f286 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:02.172268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807c1cd-57c3-4e12-aaa0-1c7bb984f286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e807c1cd-57c3-4e12-aaa0-1c7bb984f286 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:29:02.176959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:02.178122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:29:02.179181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 622/1263] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:29:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:02.186248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95aedb-ff5a-4c74-8545-f423424b1d1c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:02.204802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:02.285229 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95aedb-ff5a-4c74-8545-f423424b1d1c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:02.321535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:02.322170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:02.322457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:02.322737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:02.323403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:02.323711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:02.325083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:02.333736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 642/1264] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:29:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:02.339474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c1cd-57c3-4e12-aaa0-1c7bb984f286 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:02.406822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:02.439428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807c1cd-57c3-4e12-aaa0-1c7bb984f286 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:02.473772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:02.474457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:02.474746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:02.475023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:02.484866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:02.486353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:29:02.500855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:02.501996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:29:02.503249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:29:02.503249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:29:02.503249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:29:02.503249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 623/1265] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:02.508605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:02.590023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:02.608782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b84bfc-ec5c-4ff5-9bdf-3e522f492073 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:02.641892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:02.642498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:02.642782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:02.643058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:02.643692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:02.643997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:02.645428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:02.656705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 643/1266] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:02.662625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:02.762110 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e7277-7c0f-44f6-993c-151d54be6950 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:02.781619 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:02.796866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:02.797486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:02.797767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:02.798076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:02.805450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:02.806910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:29:02.819484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:02.820535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:29:02.821505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 624/1267] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:29:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:02.826931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:02.926955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17598fe-fc35-4104-a38e-c47911546ac6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:02.960617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:02.961213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:02.961492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:02.961761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:02.962509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:02.962812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:02.964249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:02.972729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:02.982756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 644/1268] 10.222.0.88 () {56 vars in 1143 bytes} [Fri Aug 26 00:29:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:02.988948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:03.087529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6b346-1192-43d3-b310-5d48c07e7cbc None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:03.120317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:03.120935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:03.121216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:03.121489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:03.132524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:03.134005 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:29:03.148404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:03.149591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:29:03.150519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:29:03.150519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:29:03.150519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:29:03.150519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 625/1269] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:03.155377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:03.253234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ed9ea-80ac-42ad-8f95-553b9cd812d6 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:03.287628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:03.288232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:03.288518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:03.288795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:03.289438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:03.289748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:03.291161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:03.302973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 645/1270] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:29:03.308717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:03.339727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:03.407548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ebc9-d69d-43b5-8abe-414c2fb300af None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:03.444138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:03.444769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:03.445052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:03.445327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:03.451850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:03.453291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:29:03.465156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:03.466235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:29:03.467125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 626/1271] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:03.472160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:03.531253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:03.574282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4e9c1-6efb-4336-baeb-ae3b325f06e4 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:03.608820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170eccf-8090-4412-89b6-6beaf92fde8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:03.609361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170eccf-8090-4412-89b6-6beaf92fde8c None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:03.609673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170eccf-8090-4412-89b6-6beaf92fde8c None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:03.610028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170eccf-8090-4412-89b6-6beaf92fde8c None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:03.610753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170eccf-8090-4412-89b6-6beaf92fde8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:03.611063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170eccf-8090-4412-89b6-6beaf92fde8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:03.612495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170eccf-8090-4412-89b6-6beaf92fde8c None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:03.624499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 646/1272] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:03.630806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:03.720373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:03.730878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddef1dab-5417-4744-bd03-ca68ce90f41c None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:03.763714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6924888-b686-4887-908d-86275b260a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:03.764420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924888-b686-4887-908d-86275b260a4c None admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:03.764750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924888-b686-4887-908d-86275b260a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:03.765073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6924888-b686-4887-908d-86275b260a4c None admin] PATH_INFO: `/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/07c06e04bd894c57a035e01e92610a98/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:03.767024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6924888-b686-4887-908d-86275b260a4c None admin] RBAC: Authorizing `identity:create_grant(project_id=a7e3e33d0a33462699462bf537eae60c, user_id=07c06e04bd894c57a035e01e92610a98, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:03.768447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6924888-b686-4887-908d-86275b260a4c None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:03.781258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 627/1273] 10.222.0.88 () {58 vars in 1439 bytes} [Fri Aug 26 00:29:03 2022] PUT /identity/v3/projects/a7e3e33d0a33462699462bf537eae60c/users/07c06e04bd894c57a035e01e92610a98/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:29:05.635862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2adb-7871-4f6d-8cb4-98c3ade1521f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:05.636392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2adb-7871-4f6d-8cb4-98c3ade1521f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:05.636392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f2adb-7871-4f6d-8cb4-98c3ade1521f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:05.637741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 647/1274] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:29:05.642984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109a1f-e5fb-4ee8-ab4b-712d529aa9c7 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:05.643424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109a1f-e5fb-4ee8-ab4b-712d529aa9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:05.643520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec109a1f-e5fb-4ee8-ab4b-712d529aa9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:05.661433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ec109a1f-e5fb-4ee8-ab4b-712d529aa9c7 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:29:05.662665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ec109a1f-e5fb-4ee8-ab4b-712d529aa9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:29:05.727294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 628/1275] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:29:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:29:06.008564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2adb-7871-4f6d-8cb4-98c3ade1521f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:06.108778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f2adb-7871-4f6d-8cb4-98c3ade1521f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:06.125784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:06.142834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ba8ef-fa3b-4c98-aec3-7b13df834346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:06.143452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ba8ef-fa3b-4c98-aec3-7b13df834346 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:06.143731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ba8ef-fa3b-4c98-aec3-7b13df834346 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:06.144637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623ba8ef-fa3b-4c98-aec3-7b13df834346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:06.154329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623ba8ef-fa3b-4c98-aec3-7b13df834346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-623ba8ef-fa3b-4c98-aec3-7b13df834346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 26 00:29:06.158958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:06.160100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:06.161231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 648/1276] 10.222.0.88 () {56 vars in 1096 bytes} [Fri Aug 26 00:29:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:06.166364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec109a1f-e5fb-4ee8-ab4b-712d529aa9c7 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:06.246052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:06.264734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec109a1f-e5fb-4ee8-ab4b-712d529aa9c7 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:06.298008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:06.298608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:06.298892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:06.299165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:06.299823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:06.300682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:06.302126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:06.309980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 629/1277] 10.222.0.88 () {56 vars in 1099 bytes} [Fri Aug 26 00:29:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:06.315636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ba8ef-fa3b-4c98-aec3-7b13df834346 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:06.416658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623ba8ef-fa3b-4c98-aec3-7b13df834346 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:06.451562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:06.452180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:06.452466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:06.452857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:06.463986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:06.465442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:29:06.480071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:06.481217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:29:06.482441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:29:06.482441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:29:06.482441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:06.482441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 649/1278] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:06.487097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:06.586522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1da36-225a-417c-a078-26d3a76add1a None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:06.619612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:06.620212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:06.620492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:06.620771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:06.621410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:06.621712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:06.623102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:06.634586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 630/1279] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:29:06.640364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:06.672669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:06.740503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e45b-6c3c-4350-b883-c06fbd534fee None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:06.773701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:06.774345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:06.774626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:06.774901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:06.782699 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:06.784246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 26 00:29:06.795598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:06.796750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:06.797970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 650/1280] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:29:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:06.802548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:06.806384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:06.908351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6052610-d7aa-4747-88db-97e57dd31df3 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:06.941652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:06.942377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:06.942662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:06.942934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:06.943660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:06.943966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:06.945383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:06.962822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 631/1281] 10.222.0.88 () {56 vars in 1143 bytes} [Fri Aug 26 00:29:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:06.968641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:07.059977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:07.070182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eed77f-4feb-4c8a-b1f8-ef5ee096e70b None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:07.103784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784cf72-bde4-4d68-8a4d-511faa0b9b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:07.104382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784cf72-bde4-4d68-8a4d-511faa0b9b43 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:07.104664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784cf72-bde4-4d68-8a4d-511faa0b9b43 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:07.104933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784cf72-bde4-4d68-8a4d-511faa0b9b43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:07.170663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784cf72-bde4-4d68-8a4d-511faa0b9b43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:07.171823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784cf72-bde4-4d68-8a4d-511faa0b9b43 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:07.257330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:07.267481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 651/1282] 10.222.0.88 () {58 vars in 1282 bytes} [Fri Aug 26 00:29:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 26 00:29:07.274017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:07.333731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:07.370804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcc276-eaac-4b8b-b0b3-98b645b87e16 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:07.403642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:07.404257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:07.404539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:07.404876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:07.417563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:07.419026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 26 00:29:07.433571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:07.434711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 26 00:29:07.435628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 26 00:29:07.435628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 26 00:29:07.435628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:29:07.435628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 632/1283] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:07.440604 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784cf72-bde4-4d68-8a4d-511faa0b9b43 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:07.538410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784cf72-bde4-4d68-8a4d-511faa0b9b43 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:07.572391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:07.572998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:07.573282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:07.573561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:07.574241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:07.574874 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:07.575919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:07.588164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 652/1284] 10.222.0.88 () {56 vars in 1109 bytes} [Fri Aug 26 00:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:07.593788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:07.692328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f7385-97c6-4443-ae7b-f09808bcc332 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:07.705343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:07.726024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:07.726644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:07.726931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:07.727208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:07.733677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:07.735261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 26 00:29:07.746339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:07.747386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: ERROR keystone.server.flask.application Aug 26 00:29:07.748682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 633/1285] 10.222.0.88 () {56 vars in 1111 bytes} [Fri Aug 26 00:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:07.754096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:07.805821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:07.859355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a0cee8-9785-479a-aac5-075007d2089e None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:07.892460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef2edf-a05d-4827-ae60-a6a30cf10c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:07.893063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef2edf-a05d-4827-ae60-a6a30cf10c4f None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:07.893358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef2edf-a05d-4827-ae60-a6a30cf10c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:07.893612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef2edf-a05d-4827-ae60-a6a30cf10c4f None admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:07.894520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef2edf-a05d-4827-ae60-a6a30cf10c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:07.894826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef2edf-a05d-4827-ae60-a6a30cf10c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:07.896245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef2edf-a05d-4827-ae60-a6a30cf10c4f None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:07.908317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 653/1286] 10.222.0.88 () {56 vars in 1148 bytes} [Fri Aug 26 00:29:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:07.914687 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:08.016128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e150e1-4ec6-4506-b7df-93e143647e4f None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:08.051668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c426570d-66d9-4fdb-94f3-eac09fdbd0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:08.052269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426570d-66d9-4fdb-94f3-eac09fdbd0f0 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:08.052561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426570d-66d9-4fdb-94f3-eac09fdbd0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:08.052838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c426570d-66d9-4fdb-94f3-eac09fdbd0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:08.053563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426570d-66d9-4fdb-94f3-eac09fdbd0f0 None admin] RBAC: Adding query filter params (role.id=f21c9b5697b747d39bf8f104797da245, scope.project.id=a7e3e33d0a33462699462bf537eae60c, user.id=07c06e04bd894c57a035e01e92610a98) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:08.053904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426570d-66d9-4fdb-94f3-eac09fdbd0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:08.055333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c426570d-66d9-4fdb-94f3-eac09fdbd0f0 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:08.061030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 634/1287] 10.222.0.88 () {56 vars in 1374 bytes} [Fri Aug 26 00:29:07 2022] GET /identity/v3/role_assignments?user.id=07c06e04bd894c57a035e01e92610a98&scope.project.id=a7e3e33d0a33462699462bf537eae60c&role.id=f21c9b5697b747d39bf8f104797da245 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:09.945414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aab548-1320-48d8-8b59-79232c5e166b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:09.945954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aab548-1320-48d8-8b59-79232c5e166b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:09.945954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aab548-1320-48d8-8b59-79232c5e166b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:09.947213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 654/1288] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:29:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:29:09.952470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75f09-c7ea-44f3-b10c-6249e8fcd53a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:09.952900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75f09-c7ea-44f3-b10c-6249e8fcd53a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:09.953009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa75f09-c7ea-44f3-b10c-6249e8fcd53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:09.971391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-efa75f09-c7ea-44f3-b10c-6249e8fcd53a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:29:09.972643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-efa75f09-c7ea-44f3-b10c-6249e8fcd53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:29:10.000556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:10.037637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 635/1289] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:29:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:29:10.308775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aab548-1320-48d8-8b59-79232c5e166b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:10.412003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aab548-1320-48d8-8b59-79232c5e166b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:10.422906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:10.446967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:10.447594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:10.447875 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:10.448149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:10.448723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:10.450119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:10.458868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:10.460068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:10.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 655/1290] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:29:10 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:10.465905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa75f09-c7ea-44f3-b10c-6249e8fcd53a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:10.564395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa75f09-c7ea-44f3-b10c-6249e8fcd53a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:10.598621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167d661-8cb7-4268-8ffa-0e8a0f1b2005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:10.599487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d661-8cb7-4268-8ffa-0e8a0f1b2005 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:10.599838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d661-8cb7-4268-8ffa-0e8a0f1b2005 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:10.600117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167d661-8cb7-4268-8ffa-0e8a0f1b2005 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:10.600757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167d661-8cb7-4268-8ffa-0e8a0f1b2005 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:10.601067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167d661-8cb7-4268-8ffa-0e8a0f1b2005 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:10.602468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167d661-8cb7-4268-8ffa-0e8a0f1b2005 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:10.607238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 636/1291] 10.222.0.88 () {56 vars in 1116 bytes} [Fri Aug 26 00:29:10 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:10.613089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:10.711180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068fa687-53e2-4c43-bbba-805206614121 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:10.744490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c1b95-9d5f-4e24-a5e7-2d0ef73f4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:10.745084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1b95-9d5f-4e24-a5e7-2d0ef73f4019 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:10.745363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1b95-9d5f-4e24-a5e7-2d0ef73f4019 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:10.745633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c1b95-9d5f-4e24-a5e7-2d0ef73f4019 None admin] PATH_INFO: `/v3/services` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:10.746280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c1b95-9d5f-4e24-a5e7-2d0ef73f4019 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:10.746585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c1b95-9d5f-4e24-a5e7-2d0ef73f4019 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:10.747963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c1b95-9d5f-4e24-a5e7-2d0ef73f4019 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:10.752216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 656/1292] 10.222.0.88 () {56 vars in 1116 bytes} [Fri Aug 26 00:29:10 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:12.635511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ed73-7bb6-4c35-a291-46a683b896d2 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:12.636044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ed73-7bb6-4c35-a291-46a683b896d2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:12.636044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c6ed73-7bb6-4c35-a291-46a683b896d2 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:12.637387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 637/1293] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:29:12.642496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e478d-22ab-4c08-8d99-e3ff88b9dd8f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:12.642945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e478d-22ab-4c08-8d99-e3ff88b9dd8f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:12.643048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e478d-22ab-4c08-8d99-e3ff88b9dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:12.662777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a46e478d-22ab-4c08-8d99-e3ff88b9dd8f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:29:12.663991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a46e478d-22ab-4c08-8d99-e3ff88b9dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:29:12.695049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:12.734162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 657/1294] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:29:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:29:13.003755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ed73-7bb6-4c35-a291-46a683b896d2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:13.036145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:13.108670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c6ed73-7bb6-4c35-a291-46a683b896d2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:13.143172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3affaaa-07f7-4b2e-a8dc-dd0050219c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:13.143779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3affaaa-07f7-4b2e-a8dc-dd0050219c29 None admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:13.144062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3affaaa-07f7-4b2e-a8dc-dd0050219c29 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:13.144335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3affaaa-07f7-4b2e-a8dc-dd0050219c29 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:13.145234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3affaaa-07f7-4b2e-a8dc-dd0050219c29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:13.146631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3affaaa-07f7-4b2e-a8dc-dd0050219c29 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:13.160921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 638/1295] 10.222.0.88 () {60 vars in 1141 bytes} [Fri Aug 26 00:29:13 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:29:15.172378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98161d-2fa4-488c-a5a9-d10f43497f1f None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:15.173065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98161d-2fa4-488c-a5a9-d10f43497f1f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:15.173065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98161d-2fa4-488c-a5a9-d10f43497f1f None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:15.174289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 658/1296] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:29:15.180115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f909-2ecf-4b7a-9d14-8ba1ae26a17b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:15.180528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f909-2ecf-4b7a-9d14-8ba1ae26a17b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:15.180679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672f909-2ecf-4b7a-9d14-8ba1ae26a17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:15.200679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5672f909-2ecf-4b7a-9d14-8ba1ae26a17b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:29:15.202820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5672f909-2ecf-4b7a-9d14-8ba1ae26a17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:29:15.289441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 639/1297] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:29:15 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 26 00:29:15.588561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98161d-2fa4-488c-a5a9-d10f43497f1f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:15.696759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98161d-2fa4-488c-a5a9-d10f43497f1f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:15.732433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:15.733060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:15.733364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:15.733642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:15.734258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:15.735722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:15.747144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:15.748357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:15.749183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 659/1298] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:29:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 26 00:29:15.754758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672f909-2ecf-4b7a-9d14-8ba1ae26a17b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:15.773748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:15.873504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672f909-2ecf-4b7a-9d14-8ba1ae26a17b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:15.909794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:15.911016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:15.911294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:15.911574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:15.912204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:15.912509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:15.914007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:15.918999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 640/1299] 10.222.0.88 () {56 vars in 1116 bytes} [Fri Aug 26 00:29:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:15.925384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:15.956773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:16.025463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35e1ee-2fb0-441f-8b22-f55314ff0932 None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:16.058676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962e581-b467-4861-9b76-5975e687f310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:16.059281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e581-b467-4861-9b76-5975e687f310 None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:16.059564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e581-b467-4861-9b76-5975e687f310 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:16.059841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962e581-b467-4861-9b76-5975e687f310 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:16.060535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e581-b467-4861-9b76-5975e687f310 None admin] RBAC: Adding query filter params (interface=public, service_id=cc408d59786a4259b8f4941711e816d3, region_id=RegionOne) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:16.060845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e581-b467-4861-9b76-5975e687f310 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:16.062250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962e581-b467-4861-9b76-5975e687f310 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:16.067289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 660/1300] 10.222.0.88 () {56 vars in 1251 bytes} [Fri Aug 26 00:29:15 2022] GET /identity/v3/endpoints?service_id=cc408d59786a4259b8f4941711e816d3&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:16.073028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:16.157467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:16.177250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9703d-2ce1-4abe-950e-818f540af484 None admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:16.210448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f4cd0b-fed1-41d7-b733-5ab402b5184f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:16.211037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4cd0b-fed1-41d7-b733-5ab402b5184f None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:16.211327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4cd0b-fed1-41d7-b733-5ab402b5184f None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:16.211605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f4cd0b-fed1-41d7-b733-5ab402b5184f None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:16.212213 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4cd0b-fed1-41d7-b733-5ab402b5184f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:16.213571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f4cd0b-fed1-41d7-b733-5ab402b5184f None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:16.220217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 641/1301] 10.222.0.88 () {56 vars in 1087 bytes} [Fri Aug 26 00:29:16 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:29:18.185794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890062a5-6a8f-4e2f-a47e-3e77ded0d53a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:18.186397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890062a5-6a8f-4e2f-a47e-3e77ded0d53a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:18.186397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890062a5-6a8f-4e2f-a47e-3e77ded0d53a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:18.187676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 661/1302] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:29:18.193446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f374-a26a-4db3-b627-22ad45f652d1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:18.193865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f374-a26a-4db3-b627-22ad45f652d1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:18.194014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de5f374-a26a-4db3-b627-22ad45f652d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:18.212329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1de5f374-a26a-4db3-b627-22ad45f652d1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:29:18.213529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1de5f374-a26a-4db3-b627-22ad45f652d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:29:18.279964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 642/1303] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:29:18 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 26 00:29:18.565624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890062a5-6a8f-4e2f-a47e-3e77ded0d53a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:18.667222 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:18.674995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890062a5-6a8f-4e2f-a47e-3e77ded0d53a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:18.710029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:18.710657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:18.710940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:18.711214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] PATH_INFO: `/v3/services/placement` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:18.711794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:18.713169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 26 00:29:18.722050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 26 00:29:18.723265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.get_or_create( Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application with Lock( Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self._enter() Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application return self.creator() Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application created_value = creator( Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: ERROR keystone.server.flask.application Aug 26 00:29:18.724381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 662/1304] 10.222.0.88 () {56 vars in 1117 bytes} [Fri Aug 26 00:29:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 26 00:29:18.729540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5f374-a26a-4db3-b627-22ad45f652d1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:18.806147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:18.831528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de5f374-a26a-4db3-b627-22ad45f652d1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:18.877827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4eabe-3bd0-413d-ae2a-592264934c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:18.878550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4eabe-3bd0-413d-ae2a-592264934c2a None admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:18.878987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4eabe-3bd0-413d-ae2a-592264934c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:18.879416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4eabe-3bd0-413d-ae2a-592264934c2a None admin] PATH_INFO: `/v3/services` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:18.880191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4eabe-3bd0-413d-ae2a-592264934c2a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:29:18.880536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4eabe-3bd0-413d-ae2a-592264934c2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:18.882222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4eabe-3bd0-413d-ae2a-592264934c2a None admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:18.887508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 643/1305] 10.222.0.88 () {56 vars in 1116 bytes} [Fri Aug 26 00:29:18 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:29:18.895226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:29:18.996829 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6663ed2c-2567-4c6c-9d3a-5a662a108eba None admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:29:19.031554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ada5e94-dd97-4d57-9e8e-1e8fc2da2e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:29:19.032159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada5e94-dd97-4d57-9e8e-1e8fc2da2e27 None admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:29:19.032441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada5e94-dd97-4d57-9e8e-1e8fc2da2e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:29:19.032714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ada5e94-dd97-4d57-9e8e-1e8fc2da2e27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:29:19.033375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada5e94-dd97-4d57-9e8e-1e8fc2da2e27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:29:19.034779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ada5e94-dd97-4d57-9e8e-1e8fc2da2e27 None admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:29:19.055033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 663/1306] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:29:18 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:29:28.884564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=30 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:29:29.050793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:24.446569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224aee-f535-4f05-b9fc-159f233e76a3 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:24.447603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224aee-f535-4f05-b9fc-159f233e76a3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:24.448098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49224aee-f535-4f05-b9fc-159f233e76a3 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:24.456489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2947-a339-4d81-b0e4-2cc16b292fdf None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:24.457452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2947-a339-4d81-b0e4-2cc16b292fdf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:24.457983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf2947-a339-4d81-b0e4-2cc16b292fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:24.462985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 644/1307] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:24 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:24.549354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2ddf2947-a339-4d81-b0e4-2cc16b292fdf None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:24.551617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2ddf2947-a339-4d81-b0e4-2cc16b292fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:24.678116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 664/1308] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:30:24.987101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befed934-20b1-4f40-a368-3ab2234b2936 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:24.987395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befed934-20b1-4f40-a368-3ab2234b2936 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:24.987672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befed934-20b1-4f40-a368-3ab2234b2936 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:24.989540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 645/1309] 10.222.0.88 () {54 vars in 965 bytes} [Fri Aug 26 00:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:24.996089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4c5a-f39a-4870-8d6a-0c806e7ef44b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:24.996447 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4c5a-f39a-4870-8d6a-0c806e7ef44b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:24.996658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f4c5a-f39a-4870-8d6a-0c806e7ef44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:25.094913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c89f4c5a-f39a-4870-8d6a-0c806e7ef44b None None] MFA Rules not processed for user `a0e9262597de4799a64977e44b41e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:25.096297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c89f4c5a-f39a-4870-8d6a-0c806e7ef44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:25.119306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:25.185382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 665/1310] 10.222.0.88 () {58 vars in 1062 bytes} [Fri Aug 26 00:30:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:25.195650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befed934-20b1-4f40-a368-3ab2234b2936 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:25.198184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-befed934-20b1-4f40-a368-3ab2234b2936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:25.329476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befed934-20b1-4f40-a368-3ab2234b2936 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:25.436771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00c5b1-c4ee-4296-acea-6462b229cef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:25.438062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c5b1-c4ee-4296-acea-6462b229cef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:25.438378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c5b1-c4ee-4296-acea-6462b229cef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:25.438814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00c5b1-c4ee-4296-acea-6462b229cef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:25.440533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bd00c5b1-c4ee-4296-acea-6462b229cef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:25.516037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:25.586085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00c5b1-c4ee-4296-acea-6462b229cef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:25.589499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00c5b1-c4ee-4296-acea-6462b229cef4 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:25.612226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 646/1311] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:30:27.854958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e2f3-68ed-4ca7-8f84-1a0800de0d66 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:27.855473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e2f3-68ed-4ca7-8f84-1a0800de0d66 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:27.855473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4e2f3-68ed-4ca7-8f84-1a0800de0d66 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:27.856943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 666/1312] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:27.862939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a934-6d97-49e8-b3ed-930fbcdda3bd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:27.863457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a934-6d97-49e8-b3ed-930fbcdda3bd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:27.863556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84a934-6d97-49e8-b3ed-930fbcdda3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:27.958226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ac84a934-6d97-49e8-b3ed-930fbcdda3bd None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:27.959487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ac84a934-6d97-49e8-b3ed-930fbcdda3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:28.067818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 647/1313] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:28.380110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcf53-6908-416c-a2d8-4e6d56ce04dc None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:28.380400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcf53-6908-416c-a2d8-4e6d56ce04dc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:28.380682 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85efcf53-6908-416c-a2d8-4e6d56ce04dc None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:28.382056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 667/1314] 10.222.0.88 () {54 vars in 965 bytes} [Fri Aug 26 00:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:28.389058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522879d-b6e8-4946-a9a0-458e2004e1f9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:28.389479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522879d-b6e8-4946-a9a0-458e2004e1f9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:28.389897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522879d-b6e8-4946-a9a0-458e2004e1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:28.402993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:28.470251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0522879d-b6e8-4946-a9a0-458e2004e1f9 None None] MFA Rules not processed for user `a0e9262597de4799a64977e44b41e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:28.471983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0522879d-b6e8-4946-a9a0-458e2004e1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:28.551447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 648/1315] 10.222.0.88 () {58 vars in 1062 bytes} [Fri Aug 26 00:30:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:28.560900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efcf53-6908-416c-a2d8-4e6d56ce04dc None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:28.563014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-85efcf53-6908-416c-a2d8-4e6d56ce04dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:28.676950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85efcf53-6908-416c-a2d8-4e6d56ce04dc None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:28.753629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:28.756407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d37c14-0fa6-4909-90d4-c0d1dd0cb051 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:28.757209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37c14-0fa6-4909-90d4-c0d1dd0cb051 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:28.757735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37c14-0fa6-4909-90d4-c0d1dd0cb051 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:28.758231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d37c14-0fa6-4909-90d4-c0d1dd0cb051 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:28.759882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-56d37c14-0fa6-4909-90d4-c0d1dd0cb051 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:28.876769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37c14-0fa6-4909-90d4-c0d1dd0cb051 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:28.878645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d37c14-0fa6-4909-90d4-c0d1dd0cb051 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:28.900174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 668/1316] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:30:31.464184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272114-38cb-4ac4-8bd3-e80a54f06046 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:31.464720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272114-38cb-4ac4-8bd3-e80a54f06046 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:31.464720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86272114-38cb-4ac4-8bd3-e80a54f06046 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:31.466265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 649/1317] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:31.472146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bab34-727f-4d3a-bb46-d03e690a163d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:31.472588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bab34-727f-4d3a-bb46-d03e690a163d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:31.472692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bab34-727f-4d3a-bb46-d03e690a163d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:31.541672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f27bab34-727f-4d3a-bb46-d03e690a163d None None] MFA Rules not processed for user `ae1358b70c5d4155a112c19691b493c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:31.542921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f27bab34-727f-4d3a-bb46-d03e690a163d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:31.599498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:31.648065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 669/1318] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:31 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:31.931729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86272114-38cb-4ac4-8bd3-e80a54f06046 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:31.933348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-86272114-38cb-4ac4-8bd3-e80a54f06046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:32.043517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86272114-38cb-4ac4-8bd3-e80a54f06046 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:32.046913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:32.122828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbaeffa-77b8-42f4-8329-01a71dc9c098 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:32.123450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaeffa-77b8-42f4-8329-01a71dc9c098 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:32.123726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaeffa-77b8-42f4-8329-01a71dc9c098 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:32.124477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbaeffa-77b8-42f4-8329-01a71dc9c098 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:32.126295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9cbaeffa-77b8-42f4-8329-01a71dc9c098 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:32.239483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaeffa-77b8-42f4-8329-01a71dc9c098 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:32.240956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbaeffa-77b8-42f4-8329-01a71dc9c098 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:32.260440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 650/1319] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:31 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:30:34.802559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094605d-bec6-48df-a411-95e381b3f3a2 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:34.803098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094605d-bec6-48df-a411-95e381b3f3a2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:34.803273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b094605d-bec6-48df-a411-95e381b3f3a2 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:34.805521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 670/1320] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:34.809889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e6f2-3202-4753-adba-00cb6470c89a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:34.810345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e6f2-3202-4753-adba-00cb6470c89a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:34.810451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832e6f2-3202-4753-adba-00cb6470c89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:34.856801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:34.884980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7832e6f2-3202-4753-adba-00cb6470c89a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:34.886244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7832e6f2-3202-4753-adba-00cb6470c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:34.987655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 651/1321] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:34 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:35.276788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094605d-bec6-48df-a411-95e381b3f3a2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:35.278434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b094605d-bec6-48df-a411-95e381b3f3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:35.389718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b094605d-bec6-48df-a411-95e381b3f3a2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:35.466052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d6563-c6dc-49a6-ac0f-0759da96d86d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:35.466584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6563-c6dc-49a6-ac0f-0759da96d86d service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:35.466866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6563-c6dc-49a6-ac0f-0759da96d86d service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:35.467145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d6563-c6dc-49a6-ac0f-0759da96d86d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:35.470405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f47d6563-c6dc-49a6-ac0f-0759da96d86d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:35.478504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:35.588114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6563-c6dc-49a6-ac0f-0759da96d86d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:35.589593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d6563-c6dc-49a6-ac0f-0759da96d86d service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:35.609003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 671/1322] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:30:38.247311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44de5d-ed48-4cad-8921-b3b52b56057e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:38.247884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44de5d-ed48-4cad-8921-b3b52b56057e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:38.247884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44de5d-ed48-4cad-8921-b3b52b56057e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:38.249386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 652/1323] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:38.255211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a899d-12f7-4b90-a848-8127a1631806 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:38.255638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a899d-12f7-4b90-a848-8127a1631806 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:38.255756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723a899d-12f7-4b90-a848-8127a1631806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:38.322576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-723a899d-12f7-4b90-a848-8127a1631806 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:38.323793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-723a899d-12f7-4b90-a848-8127a1631806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:38.384815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:38.425852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 672/1324] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:38.712876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44de5d-ed48-4cad-8921-b3b52b56057e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:38.714653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4e44de5d-ed48-4cad-8921-b3b52b56057e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:38.825975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44de5d-ed48-4cad-8921-b3b52b56057e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:38.838749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:38.903576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aefdb6-db6d-4177-b9f7-2d2107f48a1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:38.904187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aefdb6-db6d-4177-b9f7-2d2107f48a1b service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:38.904470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aefdb6-db6d-4177-b9f7-2d2107f48a1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:38.905375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aefdb6-db6d-4177-b9f7-2d2107f48a1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:38.907008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-66aefdb6-db6d-4177-b9f7-2d2107f48a1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:39.018546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aefdb6-db6d-4177-b9f7-2d2107f48a1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:39.019910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aefdb6-db6d-4177-b9f7-2d2107f48a1b service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:39.038630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 653/1325] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:30:41.026527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9be05a-ff99-4f7c-be54-ffb81e205781 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:41.027068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9be05a-ff99-4f7c-be54-ffb81e205781 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:41.027182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9be05a-ff99-4f7c-be54-ffb81e205781 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:41.028454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 673/1326] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:41.034401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6c5f-7721-4497-9202-813ad00fa240 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:41.034844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6c5f-7721-4497-9202-813ad00fa240 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:41.035165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae6c5f-7721-4497-9202-813ad00fa240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:41.083330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:41.102164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-adae6c5f-7721-4497-9202-813ad00fa240 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:41.103378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-adae6c5f-7721-4497-9202-813ad00fa240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:41.203148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 654/1327] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:41.494485 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9be05a-ff99-4f7c-be54-ffb81e205781 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:41.496069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9f9be05a-ff99-4f7c-be54-ffb81e205781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:41.607730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9be05a-ff99-4f7c-be54-ffb81e205781 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:41.682879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83993616-e14b-4be4-a4ec-53652dc74d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:41.683413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993616-e14b-4be4-a4ec-53652dc74d37 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:41.683694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993616-e14b-4be4-a4ec-53652dc74d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:41.683970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83993616-e14b-4be4-a4ec-53652dc74d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:41.689380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-83993616-e14b-4be4-a4ec-53652dc74d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:41.712506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:41.809176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83993616-e14b-4be4-a4ec-53652dc74d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:41.810649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83993616-e14b-4be4-a4ec-53652dc74d37 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:41.830095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 674/1328] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:30:43.855020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d29044-8142-43c8-b58b-27cb832a6b7a None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:43.855556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d29044-8142-43c8-b58b-27cb832a6b7a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:43.855852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d29044-8142-43c8-b58b-27cb832a6b7a None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:43.858922 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 655/1329] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:43.864492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdc6e-8f55-44c8-ba50-d4381f9df2d2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:43.864972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdc6e-8f55-44c8-ba50-d4381f9df2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:43.865067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bdc6e-8f55-44c8-ba50-d4381f9df2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:43.939032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a98bdc6e-8f55-44c8-ba50-d4381f9df2d2 None None] MFA Rules not processed for user `ae1358b70c5d4155a112c19691b493c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:43.940270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a98bdc6e-8f55-44c8-ba50-d4381f9df2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:44.010666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:44.051829 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 675/1330] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:43 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:30:44.363025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d29044-8142-43c8-b58b-27cb832a6b7a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:44.364573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24d29044-8142-43c8-b58b-27cb832a6b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:44.504389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d29044-8142-43c8-b58b-27cb832a6b7a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:44.526635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:44.594563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf3925-1e07-4617-a0b9-45b5112118e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:44.595171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3925-1e07-4617-a0b9-45b5112118e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:44.595453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3925-1e07-4617-a0b9-45b5112118e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:44.595732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf3925-1e07-4617-a0b9-45b5112118e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:44.597317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2bdf3925-1e07-4617-a0b9-45b5112118e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:44.707026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf3925-1e07-4617-a0b9-45b5112118e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:44.708542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf3925-1e07-4617-a0b9-45b5112118e9 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:44.727355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 656/1331] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:44 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:30:46.875371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74d56-0855-4c0e-9de5-301c9d7cc902 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:46.875938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74d56-0855-4c0e-9de5-301c9d7cc902 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:46.875938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74d56-0855-4c0e-9de5-301c9d7cc902 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:46.877233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 676/1332] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:46.882487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853c5d-7c02-4334-b059-de9366efde21 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:46.882901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853c5d-7c02-4334-b059-de9366efde21 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:46.883036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78853c5d-7c02-4334-b059-de9366efde21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:46.946086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:46.949259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-78853c5d-7c02-4334-b059-de9366efde21 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:46.950815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-78853c5d-7c02-4334-b059-de9366efde21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:47.045679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 657/1333] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:30:47.330907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74d56-0855-4c0e-9de5-301c9d7cc902 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:47.332476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-09f74d56-0855-4c0e-9de5-301c9d7cc902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:47.437057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74d56-0855-4c0e-9de5-301c9d7cc902 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:47.508244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b4821-7357-4e2d-9a76-eaa5ec692fe0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:47.508845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4821-7357-4e2d-9a76-eaa5ec692fe0 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:47.509122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4821-7357-4e2d-9a76-eaa5ec692fe0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:47.509390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b4821-7357-4e2d-9a76-eaa5ec692fe0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:47.511005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-834b4821-7357-4e2d-9a76-eaa5ec692fe0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:47.538350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:47.621305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b4821-7357-4e2d-9a76-eaa5ec692fe0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:47.622828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b4821-7357-4e2d-9a76-eaa5ec692fe0 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:47.641732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 677/1334] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:30:49.584802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597faf0-1ad8-4eef-9732-6a8311fb8e7c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:49.585236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597faf0-1ad8-4eef-9732-6a8311fb8e7c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:49.585330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597faf0-1ad8-4eef-9732-6a8311fb8e7c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:49.586707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 658/1335] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:49.592512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345d2f-7215-4f55-82b2-bcc4eac74d67 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:49.592982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345d2f-7215-4f55-82b2-bcc4eac74d67 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:49.593079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af345d2f-7215-4f55-82b2-bcc4eac74d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:49.658894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-af345d2f-7215-4f55-82b2-bcc4eac74d67 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:49.660107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-af345d2f-7215-4f55-82b2-bcc4eac74d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:49.734361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:49.757730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 678/1336] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:50.047445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597faf0-1ad8-4eef-9732-6a8311fb8e7c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:50.049056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f597faf0-1ad8-4eef-9732-6a8311fb8e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:50.151280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f597faf0-1ad8-4eef-9732-6a8311fb8e7c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:50.180545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:50.227042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493c7f9-f9d6-4d15-b508-c5b42fb4e7ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:50.227654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c7f9-f9d6-4d15-b508-c5b42fb4e7ac service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:50.227941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c7f9-f9d6-4d15-b508-c5b42fb4e7ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:50.228217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493c7f9-f9d6-4d15-b508-c5b42fb4e7ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:50.229836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2493c7f9-f9d6-4d15-b508-c5b42fb4e7ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:50.340027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c7f9-f9d6-4d15-b508-c5b42fb4e7ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:50.341641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493c7f9-f9d6-4d15-b508-c5b42fb4e7ac service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:50.359406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 659/1337] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:30:52.627997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025aa6-70f7-494c-a21a-a0e2abff10aa None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:52.628649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025aa6-70f7-494c-a21a-a0e2abff10aa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:52.628649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42025aa6-70f7-494c-a21a-a0e2abff10aa None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:52.629973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 679/1338] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:52.635521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ceff9-013a-4d42-8a78-a7ea7ecd4070 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:52.636057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ceff9-013a-4d42-8a78-a7ea7ecd4070 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:52.636057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ceff9-013a-4d42-8a78-a7ea7ecd4070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:52.706177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-316ceff9-013a-4d42-8a78-a7ea7ecd4070 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:52.707410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-316ceff9-013a-4d42-8a78-a7ea7ecd4070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:52.715820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:52.813245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 660/1339] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:53.105169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025aa6-70f7-494c-a21a-a0e2abff10aa None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:53.106777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-42025aa6-70f7-494c-a21a-a0e2abff10aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:53.215119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42025aa6-70f7-494c-a21a-a0e2abff10aa None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:53.291565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5971ec04-3795-4477-99f4-73cd36e5f07b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:53.292178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971ec04-3795-4477-99f4-73cd36e5f07b service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:53.292460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971ec04-3795-4477-99f4-73cd36e5f07b service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:53.292738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5971ec04-3795-4477-99f4-73cd36e5f07b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:53.295098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5971ec04-3795-4477-99f4-73cd36e5f07b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:53.331382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:53.407024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971ec04-3795-4477-99f4-73cd36e5f07b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:53.408394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5971ec04-3795-4477-99f4-73cd36e5f07b service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:53.428995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 680/1340] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:30:57.823526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09577-33f4-48b1-a9e9-8e5116288222 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:57.824124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09577-33f4-48b1-a9e9-8e5116288222 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:57.824225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d09577-33f4-48b1-a9e9-8e5116288222 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:57.825652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 661/1341] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:30:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:30:57.832402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093434fd-1d82-4988-a4aa-316d0a2d922f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:57.833045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093434fd-1d82-4988-a4aa-316d0a2d922f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:57.833045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093434fd-1d82-4988-a4aa-316d0a2d922f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:57.909703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-093434fd-1d82-4988-a4aa-316d0a2d922f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:30:57.910966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-093434fd-1d82-4988-a4aa-316d0a2d922f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:58.006920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:58.021305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 681/1342] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:30:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:30:58.319867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09577-33f4-48b1-a9e9-8e5116288222 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:30:58.321535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-77d09577-33f4-48b1-a9e9-8e5116288222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:58.444812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d09577-33f4-48b1-a9e9-8e5116288222 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:30:58.483415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:30:58.523635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2140d14a-06d6-4969-841d-053a0eed906c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:30:58.524343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d14a-06d6-4969-841d-053a0eed906c service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:30:58.524622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d14a-06d6-4969-841d-053a0eed906c service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:30:58.524907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2140d14a-06d6-4969-841d-053a0eed906c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:30:58.526521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2140d14a-06d6-4969-841d-053a0eed906c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:30:58.671443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140d14a-06d6-4969-841d-053a0eed906c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:30:58.673208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2140d14a-06d6-4969-841d-053a0eed906c service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:30:58.697219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 662/1343] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:01.302668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1ec8-60f1-4610-b31d-fdcfb3deb116 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:01.303161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1ec8-60f1-4610-b31d-fdcfb3deb116 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:01.303268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf1ec8-60f1-4610-b31d-fdcfb3deb116 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:01.305197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 682/1344] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:01.310656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6b73-859a-4d7d-949d-e8add836de97 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:01.311227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6b73-859a-4d7d-949d-e8add836de97 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:01.311227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b6b73-859a-4d7d-949d-e8add836de97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:01.381386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b98b6b73-859a-4d7d-949d-e8add836de97 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:01.382641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b98b6b73-859a-4d7d-949d-e8add836de97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:01.401409 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:01.483075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 663/1345] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:01.770180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf1ec8-60f1-4610-b31d-fdcfb3deb116 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:01.771708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3caf1ec8-60f1-4610-b31d-fdcfb3deb116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:01.880549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf1ec8-60f1-4610-b31d-fdcfb3deb116 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:01.956135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81417d9-60bc-4e1f-844f-81c938ed443b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:01.956747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81417d9-60bc-4e1f-844f-81c938ed443b service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:01.957029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81417d9-60bc-4e1f-844f-81c938ed443b service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:01.957302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81417d9-60bc-4e1f-844f-81c938ed443b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:01.958940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c81417d9-60bc-4e1f-844f-81c938ed443b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:02.006936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:02.076094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81417d9-60bc-4e1f-844f-81c938ed443b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:02.077551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81417d9-60bc-4e1f-844f-81c938ed443b service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:02.097304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 683/1346] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:06.402143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895b4b-c049-4458-abeb-6fcc16fa0be6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:06.402730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895b4b-c049-4458-abeb-6fcc16fa0be6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:06.403697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86895b4b-c049-4458-abeb-6fcc16fa0be6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:06.406256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 664/1347] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:06.412264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319a39-1f03-4a60-8b4d-e7dd5d9f2df4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:06.412759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319a39-1f03-4a60-8b4d-e7dd5d9f2df4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:06.412759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c319a39-1f03-4a60-8b4d-e7dd5d9f2df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:06.499552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3c319a39-1f03-4a60-8b4d-e7dd5d9f2df4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:06.500823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3c319a39-1f03-4a60-8b4d-e7dd5d9f2df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:06.626415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:06.632855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 684/1348] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:06.920509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895b4b-c049-4458-abeb-6fcc16fa0be6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:06.922125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-86895b4b-c049-4458-abeb-6fcc16fa0be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:07.064776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86895b4b-c049-4458-abeb-6fcc16fa0be6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:07.132918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:07.178812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54581b4c-9270-46ca-8e8c-5fee84bc4e3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:07.179427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581b4c-9270-46ca-8e8c-5fee84bc4e3c service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:07.179712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581b4c-9270-46ca-8e8c-5fee84bc4e3c service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:07.179987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54581b4c-9270-46ca-8e8c-5fee84bc4e3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:07.181642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-54581b4c-9270-46ca-8e8c-5fee84bc4e3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:07.303420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54581b4c-9270-46ca-8e8c-5fee84bc4e3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:07.304868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54581b4c-9270-46ca-8e8c-5fee84bc4e3c service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:07.326485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 665/1349] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:12.618470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab2499-114e-4f22-95d5-42dc2bd1b8a2 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:12.618982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab2499-114e-4f22-95d5-42dc2bd1b8a2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:12.618982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ab2499-114e-4f22-95d5-42dc2bd1b8a2 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:12.620851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 685/1350] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:12.627205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bf7f-43f2-48c7-b93a-ce50f513dc8a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:12.627725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bf7f-43f2-48c7-b93a-ce50f513dc8a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:12.627970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c2bf7f-43f2-48c7-b93a-ce50f513dc8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:12.789861 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-69c2bf7f-43f2-48c7-b93a-ce50f513dc8a None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:12.794230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-69c2bf7f-43f2-48c7-b93a-ce50f513dc8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:12.818172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:12.927079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 666/1351] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:31:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:17.270046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df8dd-b2ab-40a7-8d2a-2cbe6c49bba6 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:17.270910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df8dd-b2ab-40a7-8d2a-2cbe6c49bba6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:17.271432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8df8dd-b2ab-40a7-8d2a-2cbe6c49bba6 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:17.272867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 686/1352] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:17.277766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94bd67-b8bf-4cd3-bd4d-51d530880927 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:17.278290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94bd67-b8bf-4cd3-bd4d-51d530880927 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:17.278375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94bd67-b8bf-4cd3-bd4d-51d530880927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:17.382719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4f94bd67-b8bf-4cd3-bd4d-51d530880927 None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:17.384087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4f94bd67-b8bf-4cd3-bd4d-51d530880927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:17.498297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:17.548964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 667/1353] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:31:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:18.914791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b94eec-e95e-4100-a4c4-9c0fc38847a0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:18.915312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b94eec-e95e-4100-a4c4-9c0fc38847a0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:18.915312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b94eec-e95e-4100-a4c4-9c0fc38847a0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:18.916561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 687/1354] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:18.922689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c187-6018-4062-8ec8-61542aaec442 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:18.923158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c187-6018-4062-8ec8-61542aaec442 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:18.923302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064c187-6018-4062-8ec8-61542aaec442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:19.006910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c064c187-6018-4062-8ec8-61542aaec442 None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:19.008127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c064c187-6018-4062-8ec8-61542aaec442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:19.126992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 668/1355] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:31:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:22.535928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e8e0-877b-40e8-bf32-38f98f635b9c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:22.536483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e8e0-877b-40e8-bf32-38f98f635b9c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:22.536917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e5e8e0-877b-40e8-bf32-38f98f635b9c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:22.539302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 688/1356] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:22.545926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35eef-7836-43bd-a42d-2fb900b013cb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:22.546368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35eef-7836-43bd-a42d-2fb900b013cb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:22.546608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb35eef-7836-43bd-a42d-2fb900b013cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:22.586432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:22.633162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8fb35eef-7836-43bd-a42d-2fb900b013cb None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:22.634441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8fb35eef-7836-43bd-a42d-2fb900b013cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:22.767800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 669/1357] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:23.079347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70b6cd-fd91-4b49-a711-e86f3d3862c9 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:23.080453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70b6cd-fd91-4b49-a711-e86f3d3862c9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:23.080938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70b6cd-fd91-4b49-a711-e86f3d3862c9 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:23.085839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 689/1358] 10.222.0.88 () {54 vars in 962 bytes} [Fri Aug 26 00:31:23 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:23.093624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72f8f-6024-43fc-96a0-2b5e67773b38 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:23.094036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72f8f-6024-43fc-96a0-2b5e67773b38 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:23.094559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c72f8f-6024-43fc-96a0-2b5e67773b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:23.200987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d7c72f8f-6024-43fc-96a0-2b5e67773b38 None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:23.202313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d7c72f8f-6024-43fc-96a0-2b5e67773b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:23.266277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:23.342582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 670/1359] 10.222.0.88 () {58 vars in 1059 bytes} [Fri Aug 26 00:31:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:23.350282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70b6cd-fd91-4b49-a711-e86f3d3862c9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:23.351804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-eb70b6cd-fd91-4b49-a711-e86f3d3862c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:23.538947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70b6cd-fd91-4b49-a711-e86f3d3862c9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:23.627296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:23.671724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866cb2f-45ac-4f7b-9bb3-1b77c77d6322 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:23.672546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cb2f-45ac-4f7b-9bb3-1b77c77d6322 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:23.672926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cb2f-45ac-4f7b-9bb3-1b77c77d6322 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:23.673303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866cb2f-45ac-4f7b-9bb3-1b77c77d6322 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:23.675076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2866cb2f-45ac-4f7b-9bb3-1b77c77d6322 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:23.795190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866cb2f-45ac-4f7b-9bb3-1b77c77d6322 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:23.797107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2866cb2f-45ac-4f7b-9bb3-1b77c77d6322 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:23.837376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 690/1360] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:26.074034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447391e3-5766-41aa-ba70-5553f41d9c15 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:26.074621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447391e3-5766-41aa-ba70-5553f41d9c15 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:26.074733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447391e3-5766-41aa-ba70-5553f41d9c15 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:26.078226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 671/1361] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:26.082015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cba9-c5ae-4022-b259-a2481aeba1b1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:26.082553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cba9-c5ae-4022-b259-a2481aeba1b1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:26.082553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1cba9-c5ae-4022-b259-a2481aeba1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:26.167931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-31d1cba9-c5ae-4022-b259-a2481aeba1b1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:26.169607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-31d1cba9-c5ae-4022-b259-a2481aeba1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:26.219072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:26.316620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 691/1362] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:26.617166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447391e3-5766-41aa-ba70-5553f41d9c15 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:26.618736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-447391e3-5766-41aa-ba70-5553f41d9c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:26.799187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447391e3-5766-41aa-ba70-5553f41d9c15 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:26.810613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:26.929114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a470ae80-f165-4ec3-b948-eca0ff283323 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:26.929982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ae80-f165-4ec3-b948-eca0ff283323 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:26.930531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ae80-f165-4ec3-b948-eca0ff283323 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:26.930671 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a470ae80-f165-4ec3-b948-eca0ff283323 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:26.932450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a470ae80-f165-4ec3-b948-eca0ff283323 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:27.034642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ae80-f165-4ec3-b948-eca0ff283323 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:27.036245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a470ae80-f165-4ec3-b948-eca0ff283323 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:27.056019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 672/1363] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:29.340090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb197-5cda-4707-a475-7ab823ebd5d4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:29.340639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb197-5cda-4707-a475-7ab823ebd5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:29.340639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916eb197-5cda-4707-a475-7ab823ebd5d4 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:29.341982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 692/1364] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:29.347563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc140aa-f693-4cde-bf9a-9ef7d64a02ba None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:29.348255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc140aa-f693-4cde-bf9a-9ef7d64a02ba None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:29.348255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc140aa-f693-4cde-bf9a-9ef7d64a02ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:29.370329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:29.429291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5fc140aa-f693-4cde-bf9a-9ef7d64a02ba None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:29.430566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5fc140aa-f693-4cde-bf9a-9ef7d64a02ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:29.539350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 673/1365] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:31:29.857828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98459f-b32d-4e50-a390-7cfbae628f8d None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:29.858209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98459f-b32d-4e50-a390-7cfbae628f8d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:29.858461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98459f-b32d-4e50-a390-7cfbae628f8d None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:29.859903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 693/1366] 10.222.0.88 () {54 vars in 962 bytes} [Fri Aug 26 00:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:29.866028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a36f-c1ff-445e-abd3-f5a50d36d015 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:29.866673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a36f-c1ff-445e-abd3-f5a50d36d015 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:29.867175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2a36f-c1ff-445e-abd3-f5a50d36d015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:29.961939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1fb2a36f-c1ff-445e-abd3-f5a50d36d015 None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:29.963818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1fb2a36f-c1ff-445e-abd3-f5a50d36d015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:30.004185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:30.108302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98459f-b32d-4e50-a390-7cfbae628f8d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:30.110355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1d98459f-b32d-4e50-a390-7cfbae628f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:30.119331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 674/1367] 10.222.0.88 () {58 vars in 1059 bytes} [Fri Aug 26 00:31:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:30.279131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98459f-b32d-4e50-a390-7cfbae628f8d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:30.303392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:30.412350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2ef6ba-d815-40d9-a01d-58b84254bb86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:30.413347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef6ba-d815-40d9-a01d-58b84254bb86 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:30.413723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef6ba-d815-40d9-a01d-58b84254bb86 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:30.414123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ef6ba-d815-40d9-a01d-58b84254bb86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:30.415825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dd2ef6ba-d815-40d9-a01d-58b84254bb86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:30.512039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ef6ba-d815-40d9-a01d-58b84254bb86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:30.514205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2ef6ba-d815-40d9-a01d-58b84254bb86 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:30.534618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 694/1368] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:31.213638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f8d8-8d20-44d2-9440-6486b156173c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:31.214323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f8d8-8d20-44d2-9440-6486b156173c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:31.214323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871f8d8-8d20-44d2-9440-6486b156173c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:31.216666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 675/1369] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:31.221907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f91dc-48c5-4daf-ac4a-bd310d841bf6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:31.222204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f91dc-48c5-4daf-ac4a-bd310d841bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:31.222487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24f91dc-48c5-4daf-ac4a-bd310d841bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:31.257051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:31.295104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e24f91dc-48c5-4daf-ac4a-bd310d841bf6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:31.296333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e24f91dc-48c5-4daf-ac4a-bd310d841bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:31.406080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 695/1370] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:31.998510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e707-90d3-494e-b90b-9780c82a6f5d None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:31.999040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e707-90d3-494e-b90b-9780c82a6f5d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:31.999418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324e707-90d3-494e-b90b-9780c82a6f5d None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:32.000996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 676/1371] 10.222.0.88 () {54 vars in 964 bytes} [Fri Aug 26 00:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:32.007388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7baf-f4ab-4761-80bb-0f972c8e4b9c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:32.007983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7baf-f4ab-4761-80bb-0f972c8e4b9c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:32.007983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee7baf-f4ab-4761-80bb-0f972c8e4b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:32.095430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ffee7baf-f4ab-4761-80bb-0f972c8e4b9c None None] MFA Rules not processed for user `a0d14a63f09046efb6d5c2533f6d3609`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:32.096639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ffee7baf-f4ab-4761-80bb-0f972c8e4b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:32.144799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:32.176787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 696/1372] 10.222.0.88 () {58 vars in 1061 bytes} [Fri Aug 26 00:31:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:32.184402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324e707-90d3-494e-b90b-9780c82a6f5d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:32.186060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3324e707-90d3-494e-b90b-9780c82a6f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:32.298387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324e707-90d3-494e-b90b-9780c82a6f5d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:32.355681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:32.398510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d526393-bbfe-4380-aa92-4926c57194b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:32.399276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526393-bbfe-4380-aa92-4926c57194b5 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:32.399660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526393-bbfe-4380-aa92-4926c57194b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:32.400037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d526393-bbfe-4380-aa92-4926c57194b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:32.402101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6d526393-bbfe-4380-aa92-4926c57194b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:32.535921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d526393-bbfe-4380-aa92-4926c57194b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:32.537424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d526393-bbfe-4380-aa92-4926c57194b5 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:32.582127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 677/1373] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:32.583969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67d73-501f-4ceb-bda4-11235e2d5ef0 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:32.584264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67d73-501f-4ceb-bda4-11235e2d5ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:32.584548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d67d73-501f-4ceb-bda4-11235e2d5ef0 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:32.586047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 697/1374] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:32.592754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0490d-d839-430a-8e83-b5806aa92b37 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:32.593047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0490d-d839-430a-8e83-b5806aa92b37 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:32.593319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0490d-d839-430a-8e83-b5806aa92b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:32.727960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-85f0490d-d839-430a-8e83-b5806aa92b37 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:32.729293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-85f0490d-d839-430a-8e83-b5806aa92b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:32.753860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:32.836292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 678/1375] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:31:33.138415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67d73-501f-4ceb-bda4-11235e2d5ef0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:33.139940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f3d67d73-501f-4ceb-bda4-11235e2d5ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:33.296421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d67d73-501f-4ceb-bda4-11235e2d5ef0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:33.350165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:33.414468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846bbabb-aea7-421e-bcac-5559a2357aa9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:33.414999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bbabb-aea7-421e-bcac-5559a2357aa9 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:33.415286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bbabb-aea7-421e-bcac-5559a2357aa9 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:33.415565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846bbabb-aea7-421e-bcac-5559a2357aa9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:33.417188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-846bbabb-aea7-421e-bcac-5559a2357aa9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:33.510002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bbabb-aea7-421e-bcac-5559a2357aa9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:33.512108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846bbabb-aea7-421e-bcac-5559a2357aa9 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:33.530605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 698/1376] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:35.498406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7cc8-8a6e-442f-9f4e-774f18693d61 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:35.498940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7cc8-8a6e-442f-9f4e-774f18693d61 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:35.498940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b7cc8-8a6e-442f-9f4e-774f18693d61 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:35.500325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 679/1377] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:35.505737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a6ed1-38b1-4d3e-b689-cdf4cdb9190e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:35.506193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a6ed1-38b1-4d3e-b689-cdf4cdb9190e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:35.506336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a6ed1-38b1-4d3e-b689-cdf4cdb9190e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:35.585469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-674a6ed1-38b1-4d3e-b689-cdf4cdb9190e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:35.586741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-674a6ed1-38b1-4d3e-b689-cdf4cdb9190e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:35.594176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:35.707909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 699/1378] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:36.012295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b7cc8-8a6e-442f-9f4e-774f18693d61 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:36.014002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8a9b7cc8-8a6e-442f-9f4e-774f18693d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:36.223738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b7cc8-8a6e-442f-9f4e-774f18693d61 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:36.233197 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:36.361173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894903ff-f085-4d24-9e4a-6dca264a806d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:36.361928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894903ff-f085-4d24-9e4a-6dca264a806d service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:36.362467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894903ff-f085-4d24-9e4a-6dca264a806d service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:36.362846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894903ff-f085-4d24-9e4a-6dca264a806d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:36.365136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-894903ff-f085-4d24-9e4a-6dca264a806d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:36.474935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894903ff-f085-4d24-9e4a-6dca264a806d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:36.476813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894903ff-f085-4d24-9e4a-6dca264a806d service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:36.498988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 680/1379] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:38.488348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fd68b-b4fc-4692-b320-604ea1f660a2 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:38.489381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fd68b-b4fc-4692-b320-604ea1f660a2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:38.490669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88fd68b-b4fc-4692-b320-604ea1f660a2 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:38.492357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 700/1380] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:38.497976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a1ba-170c-4303-a934-0f4f88598ed1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:38.498417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a1ba-170c-4303-a934-0f4f88598ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:38.498607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927a1ba-170c-4303-a934-0f4f88598ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:38.510117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:38.703432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e927a1ba-170c-4303-a934-0f4f88598ed1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:38.704724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e927a1ba-170c-4303-a934-0f4f88598ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:38.812663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 681/1381] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:39.114320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fd68b-b4fc-4692-b320-604ea1f660a2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:39.115860 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b88fd68b-b4fc-4692-b320-604ea1f660a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:39.267270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:39.285681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88fd68b-b4fc-4692-b320-604ea1f660a2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:39.413564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034fb73-b64b-430d-8278-5293a98f7895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:39.414549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034fb73-b64b-430d-8278-5293a98f7895 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:39.414946 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034fb73-b64b-430d-8278-5293a98f7895 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:39.415319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034fb73-b64b-430d-8278-5293a98f7895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:39.417030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6034fb73-b64b-430d-8278-5293a98f7895 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:39.518217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034fb73-b64b-430d-8278-5293a98f7895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:39.520008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034fb73-b64b-430d-8278-5293a98f7895 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:39.531269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:39.541672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 701/1382] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:41.685209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc649a6-0201-4358-8639-8c9e6ce05908 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:41.685770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc649a6-0201-4358-8639-8c9e6ce05908 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:41.685871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc649a6-0201-4358-8639-8c9e6ce05908 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:41.687418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 682/1383] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:41.693547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc5a7-cd22-4666-9674-c9b24617113f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:41.694298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc5a7-cd22-4666-9674-c9b24617113f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:41.694298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdc5a7-cd22-4666-9674-c9b24617113f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:41.766938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-30fdc5a7-cd22-4666-9674-c9b24617113f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:41.768279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-30fdc5a7-cd22-4666-9674-c9b24617113f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:41.886019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 702/1384] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:42.179726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc649a6-0201-4358-8639-8c9e6ce05908 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:42.181328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3fc649a6-0201-4358-8639-8c9e6ce05908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:42.275215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:42.337951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc649a6-0201-4358-8639-8c9e6ce05908 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:42.475985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d442e21-ef1b-443e-8563-816d9b2dbe54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:42.476617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e21-ef1b-443e-8563-816d9b2dbe54 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:42.476883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e21-ef1b-443e-8563-816d9b2dbe54 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:42.477155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d442e21-ef1b-443e-8563-816d9b2dbe54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:42.478773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8d442e21-ef1b-443e-8563-816d9b2dbe54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:42.531493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:42.579433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442e21-ef1b-443e-8563-816d9b2dbe54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:42.581960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d442e21-ef1b-443e-8563-816d9b2dbe54 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:42.604716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 683/1385] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:31:44.999973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a49761-01b9-4b3d-b8a4-0ba10d858413 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:45.000863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a49761-01b9-4b3d-b8a4-0ba10d858413 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:45.000863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a49761-01b9-4b3d-b8a4-0ba10d858413 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:45.001897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 703/1386] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:45.007548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf239ce-5f62-4fdc-bc13-3421abee65bc None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:45.008032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf239ce-5f62-4fdc-bc13-3421abee65bc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:45.008233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf239ce-5f62-4fdc-bc13-3421abee65bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:45.095723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bcf239ce-5f62-4fdc-bc13-3421abee65bc None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:45.097688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bcf239ce-5f62-4fdc-bc13-3421abee65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:45.232064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 684/1387] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:31:45.575914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a49761-01b9-4b3d-b8a4-0ba10d858413 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:45.578007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-63a49761-01b9-4b3d-b8a4-0ba10d858413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:45.667622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:45.783149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a49761-01b9-4b3d-b8a4-0ba10d858413 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:45.931030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e9c8b-519a-4735-8cf6-1f9e11ee1e0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:45.931422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e9c8b-519a-4735-8cf6-1f9e11ee1e0d service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:45.931726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e9c8b-519a-4735-8cf6-1f9e11ee1e0d service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:45.931988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e9c8b-519a-4735-8cf6-1f9e11ee1e0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:45.933618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-339e9c8b-519a-4735-8cf6-1f9e11ee1e0d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:45.977974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:46.031993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e9c8b-519a-4735-8cf6-1f9e11ee1e0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:46.033613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e9c8b-519a-4735-8cf6-1f9e11ee1e0d service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:46.052326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 704/1388] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:47.976055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c787e-9aab-45d3-a4ca-c90b050dcccb None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:47.976674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c787e-9aab-45d3-a4ca-c90b050dcccb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:47.976674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c787e-9aab-45d3-a4ca-c90b050dcccb None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:47.977983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 685/1389] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:47.983901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677beac0-9653-46d5-91f6-9a0ec08e7ef5 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:47.984367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677beac0-9653-46d5-91f6-9a0ec08e7ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:47.984471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677beac0-9653-46d5-91f6-9a0ec08e7ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:48.030499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f45f9a-c0d1-43fe-bec5-ca246384fba5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:48.030900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f45f9a-c0d1-43fe-bec5-ca246384fba5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:48.031239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f45f9a-c0d1-43fe-bec5-ca246384fba5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:48.032577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 686/1390] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:31:48.037719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096391f-ff63-42d3-b972-61a16dd3e718 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:48.038044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096391f-ff63-42d3-b972-61a16dd3e718 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:48.038326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096391f-ff63-42d3-b972-61a16dd3e718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:48.057260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-677beac0-9653-46d5-91f6-9a0ec08e7ef5 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:48.058522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-677beac0-9653-46d5-91f6-9a0ec08e7ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:48.075486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:48.108816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3096391f-ff63-42d3-b972-61a16dd3e718 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:48.110102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3096391f-ff63-42d3-b972-61a16dd3e718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:48.158377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 705/1391] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:48.211249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 687/1392] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:31:48.471712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42ffa-b948-40a3-9d72-89de45043883 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:48.471999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42ffa-b948-40a3-9d72-89de45043883 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:48.472273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b42ffa-b948-40a3-9d72-89de45043883 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:48.473620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 706/1393] 10.222.0.88 () {54 vars in 967 bytes} [Fri Aug 26 00:31:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:48.478859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198b1e-15ef-4acb-a954-39ccf7280994 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:48.479152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198b1e-15ef-4acb-a954-39ccf7280994 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:48.479425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e198b1e-15ef-4acb-a954-39ccf7280994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:48.510884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b42ffa-b948-40a3-9d72-89de45043883 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:48.512844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-48b42ffa-b948-40a3-9d72-89de45043883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:48.527075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:48.566276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1e198b1e-15ef-4acb-a954-39ccf7280994 None None] MFA Rules not processed for user `2be2cb98356b4d628408d094589a83e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:48.567566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1e198b1e-15ef-4acb-a954-39ccf7280994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:48.622929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:48.651860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 688/1394] 10.222.0.88 () {58 vars in 1064 bytes} [Fri Aug 26 00:31:48 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:48.660299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e198b1e-15ef-4acb-a954-39ccf7280994 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:48.667285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b42ffa-b948-40a3-9d72-89de45043883 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:48.668193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e198b1e-15ef-4acb-a954-39ccf7280994 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:48.750563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66c36-d243-46a6-a241-993b58bfbb3c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be2cb98356b4d628408d094589a83e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:48.751169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66c36-d243-46a6-a241-993b58bfbb3c service glance] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:48.751445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66c36-d243-46a6-a241-993b58bfbb3c service glance] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:48.751713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66c36-d243-46a6-a241-993b58bfbb3c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:48.753307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-45a66c36-d243-46a6-a241-993b58bfbb3c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:48.765356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:48.799121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f4411-f586-4f49-acf1-cc78cd898a7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:48.799738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f4411-f586-4f49-acf1-cc78cd898a7a service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:48.800022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f4411-f586-4f49-acf1-cc78cd898a7a service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:48.800295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f4411-f586-4f49-acf1-cc78cd898a7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:48.801943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e76f4411-f586-4f49-acf1-cc78cd898a7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:48.882819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a66c36-d243-46a6-a241-993b58bfbb3c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:48.884261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a66c36-d243-46a6-a241-993b58bfbb3c service glance] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:48.899926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:48.901018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f4411-f586-4f49-acf1-cc78cd898a7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:48.903559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f4411-f586-4f49-acf1-cc78cd898a7a service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:48.906117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 689/1395] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:31:48.923132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 707/1396] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:31:49.658857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f1d7-ec60-47d0-b030-f5b57666593c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:49.659376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f1d7-ec60-47d0-b030-f5b57666593c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:49.659487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f1d7-ec60-47d0-b030-f5b57666593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:49.727224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-18e5f1d7-ec60-47d0-b030-f5b57666593c None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:49.728435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-18e5f1d7-ec60-47d0-b030-f5b57666593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:49.816024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 690/1397] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:49.859911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88ea4-8ffe-48cf-985b-b3a31073e57d None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:49.860422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88ea4-8ffe-48cf-985b-b3a31073e57d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:49.860517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd88ea4-8ffe-48cf-985b-b3a31073e57d None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:49.861841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 708/1398] 10.222.0.88 () {54 vars in 943 bytes} [Fri Aug 26 00:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:49.868464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf0234-9fa9-4f9e-ac3d-4a43d5709c0b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:49.868828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf0234-9fa9-4f9e-ac3d-4a43d5709c0b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:49.869173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf0234-9fa9-4f9e-ac3d-4a43d5709c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:49.954511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d9bf0234-9fa9-4f9e-ac3d-4a43d5709c0b None None] MFA Rules not processed for user `c266ac5c785d46488a1a1560283ba4fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:49.955768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d9bf0234-9fa9-4f9e-ac3d-4a43d5709c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:49.986090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:50.090129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 691/1399] 10.222.0.88 () {58 vars in 1040 bytes} [Fri Aug 26 00:31:49 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:50.100537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd88ea4-8ffe-48cf-985b-b3a31073e57d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:50.102153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9bd88ea4-8ffe-48cf-985b-b3a31073e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:50.197968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:50.241224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd88ea4-8ffe-48cf-985b-b3a31073e57d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:50.347493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015d48d-98a1-46fc-ad93-cabae69cd9c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:50.348018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d48d-98a1-46fc-ad93-cabae69cd9c8 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:50.348295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d48d-98a1-46fc-ad93-cabae69cd9c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:50.348562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015d48d-98a1-46fc-ad93-cabae69cd9c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:50.350205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1015d48d-98a1-46fc-ad93-cabae69cd9c8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:50.439070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015d48d-98a1-46fc-ad93-cabae69cd9c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:50.440900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015d48d-98a1-46fc-ad93-cabae69cd9c8 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:50.444519 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:50.451621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 709/1400] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:31:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:31:50.915606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70378a1-afb3-42fb-97f1-41a30e87d51c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:50.916171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70378a1-afb3-42fb-97f1-41a30e87d51c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:50.916171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70378a1-afb3-42fb-97f1-41a30e87d51c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:50.917909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 692/1401] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:50.922915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706acc3e-9b7a-4ee7-8ef6-0eef87624d98 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:50.923457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706acc3e-9b7a-4ee7-8ef6-0eef87624d98 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:50.923457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706acc3e-9b7a-4ee7-8ef6-0eef87624d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:50.994093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-706acc3e-9b7a-4ee7-8ef6-0eef87624d98 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:50.995329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-706acc3e-9b7a-4ee7-8ef6-0eef87624d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:51.108809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 710/1402] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:51.404082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70378a1-afb3-42fb-97f1-41a30e87d51c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:51.406470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b70378a1-afb3-42fb-97f1-41a30e87d51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:51.583571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70378a1-afb3-42fb-97f1-41a30e87d51c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:51.586568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:51.719541 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3b3c8-a3a6-4b00-aa37-7156d30b8340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:51.720498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3b3c8-a3a6-4b00-aa37-7156d30b8340 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:51.720916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3b3c8-a3a6-4b00-aa37-7156d30b8340 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:51.721195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3b3c8-a3a6-4b00-aa37-7156d30b8340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:51.722870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-05b3b3c8-a3a6-4b00-aa37-7156d30b8340 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:51.823341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3b3c8-a3a6-4b00-aa37-7156d30b8340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:51.825266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3b3c8-a3a6-4b00-aa37-7156d30b8340 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:51.845709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 693/1403] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:53.893388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bca293-208d-4324-a9e1-c15f11c1e170 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:53.894016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bca293-208d-4324-a9e1-c15f11c1e170 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:53.894337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bca293-208d-4324-a9e1-c15f11c1e170 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:53.896889 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 711/1404] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:53.902604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66201-df10-4671-98fc-a2a25cd7c1a9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:53.903705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66201-df10-4671-98fc-a2a25cd7c1a9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:53.903804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b66201-df10-4671-98fc-a2a25cd7c1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:53.915514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:53.980044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d0b66201-df10-4671-98fc-a2a25cd7c1a9 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:53.982103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d0b66201-df10-4671-98fc-a2a25cd7c1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:54.099312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 694/1405] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:54.392385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bca293-208d-4324-a9e1-c15f11c1e170 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:54.393942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f4bca293-208d-4324-a9e1-c15f11c1e170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:54.491298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:54.580125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bca293-208d-4324-a9e1-c15f11c1e170 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:54.714530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091b942-2ef5-44e6-9ad9-688106992413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:54.715151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091b942-2ef5-44e6-9ad9-688106992413 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:54.715435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091b942-2ef5-44e6-9ad9-688106992413 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:54.715749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091b942-2ef5-44e6-9ad9-688106992413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:54.717386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9091b942-2ef5-44e6-9ad9-688106992413 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:54.764146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:54.818864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091b942-2ef5-44e6-9ad9-688106992413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:54.820535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091b942-2ef5-44e6-9ad9-688106992413 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:54.846052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 712/1406] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:31:56.847832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e35e-a55f-4fef-aeb1-74973a461bf8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:56.848391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e35e-a55f-4fef-aeb1-74973a461bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:56.848482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0e35e-a55f-4fef-aeb1-74973a461bf8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:56.850051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 695/1407] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:31:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:31:56.858427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9ae2-ea86-496b-ba10-c064fabf76e4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:56.858966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9ae2-ea86-496b-ba10-c064fabf76e4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:56.858966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d9ae2-ea86-496b-ba10-c064fabf76e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:56.940781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-290d9ae2-ea86-496b-ba10-c064fabf76e4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:31:56.941949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-290d9ae2-ea86-496b-ba10-c064fabf76e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:57.055145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 713/1408] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:31:57.352934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e35e-a55f-4fef-aeb1-74973a461bf8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:31:57.354483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2dc0e35e-a55f-4fef-aeb1-74973a461bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:57.452678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:57.527090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0e35e-a55f-4fef-aeb1-74973a461bf8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:31:57.666992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83983c22-2bb3-4de2-a05c-346fe34c8c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:31:57.667499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983c22-2bb3-4de2-a05c-346fe34c8c84 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:31:57.667777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983c22-2bb3-4de2-a05c-346fe34c8c84 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:31:57.668048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83983c22-2bb3-4de2-a05c-346fe34c8c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:31:57.669756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-83983c22-2bb3-4de2-a05c-346fe34c8c84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:31:57.726949 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:31:57.780463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83983c22-2bb3-4de2-a05c-346fe34c8c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:31:57.782082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83983c22-2bb3-4de2-a05c-346fe34c8c84 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:31:57.810176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 696/1409] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:31:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:07.053157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=93 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:07.799443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=24 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:12.986933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc8db8-2c79-48c2-a337-4d5fc8f3aa9a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:12.987495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc8db8-2c79-48c2-a337-4d5fc8f3aa9a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:12.987691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc8db8-2c79-48c2-a337-4d5fc8f3aa9a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:12.989120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 714/1410] 10.222.0.88 () {54 vars in 918 bytes} [Fri Aug 26 00:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:12.994569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c16f-1757-416e-beb8-b775b7a28a39 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:12.995077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c16f-1757-416e-beb8-b775b7a28a39 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:12.995174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38c16f-1757-416e-beb8-b775b7a28a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:13.081437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-dc38c16f-1757-416e-beb8-b775b7a28a39 None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:13.082736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dc38c16f-1757-416e-beb8-b775b7a28a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:13.213411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 697/1411] 10.222.0.88 () {58 vars in 1015 bytes} [Fri Aug 26 00:32:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:13.228070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319de31-56ac-42cc-9746-030563687a92 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:13.228357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319de31-56ac-42cc-9746-030563687a92 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:13.228653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319de31-56ac-42cc-9746-030563687a92 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:13.230037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 715/1412] 10.222.0.88 () {54 vars in 918 bytes} [Fri Aug 26 00:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:13.236070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba30f8-c4cd-4b06-809d-4b8ec5cf8158 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:13.236356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba30f8-c4cd-4b06-809d-4b8ec5cf8158 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:13.236632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba30f8-c4cd-4b06-809d-4b8ec5cf8158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:13.315209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:13.317962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5aba30f8-c4cd-4b06-809d-4b8ec5cf8158 None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:13.320067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5aba30f8-c4cd-4b06-809d-4b8ec5cf8158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:13.447168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 698/1413] 10.222.0.88 () {58 vars in 1015 bytes} [Fri Aug 26 00:32:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:15.896397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297265c3-3703-48a2-9c48-5355c0f5d5e5 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:15.896976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297265c3-3703-48a2-9c48-5355c0f5d5e5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:15.896976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297265c3-3703-48a2-9c48-5355c0f5d5e5 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:15.898310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:15.904221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586ca1-d16d-4e0b-b5eb-158b12d306d3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:15.904740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586ca1-d16d-4e0b-b5eb-158b12d306d3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:15.904850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31586ca1-d16d-4e0b-b5eb-158b12d306d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:15.977222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-31586ca1-d16d-4e0b-b5eb-158b12d306d3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:15.978492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-31586ca1-d16d-4e0b-b5eb-158b12d306d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:16.039259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:16.088087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:16.424566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297265c3-3703-48a2-9c48-5355c0f5d5e5 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:16.426398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-297265c3-3703-48a2-9c48-5355c0f5d5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:16.589578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297265c3-3703-48a2-9c48-5355c0f5d5e5 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:16.674844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:16.720629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502223ea-25b9-4759-ae4e-4ebb3282ba62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:16.721376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502223ea-25b9-4759-ae4e-4ebb3282ba62 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:16.722768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502223ea-25b9-4759-ae4e-4ebb3282ba62 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:16.722768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502223ea-25b9-4759-ae4e-4ebb3282ba62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:16.723783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-502223ea-25b9-4759-ae4e-4ebb3282ba62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:16.815577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502223ea-25b9-4759-ae4e-4ebb3282ba62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:16.817184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502223ea-25b9-4759-ae4e-4ebb3282ba62 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:16.836074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 717/1416] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:17.731627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc8372-bc08-4e76-a635-365a2af57031 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:17.732200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc8372-bc08-4e76-a635-365a2af57031 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:17.732200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc8372-bc08-4e76-a635-365a2af57031 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:17.734108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:32:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:17.739159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ded7-4eee-4363-92d3-3ec2d9429357 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:17.739586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ded7-4eee-4363-92d3-3ec2d9429357 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:17.739698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3ded7-4eee-4363-92d3-3ec2d9429357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:17.816575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c2b3ded7-4eee-4363-92d3-3ec2d9429357 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:17.817790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c2b3ded7-4eee-4363-92d3-3ec2d9429357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:17.844469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:17.914511 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:18.066441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc8372-bc08-4e76-a635-365a2af57031 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:18.067973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c1dc8372-bc08-4e76-a635-365a2af57031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:18.217804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc8372-bc08-4e76-a635-365a2af57031 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:18.259446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:18.340657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8f5d5-7f88-4a9c-8218-c8bd21f60990 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:18.341277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f5d5-7f88-4a9c-8218-c8bd21f60990 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:18.341558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f5d5-7f88-4a9c-8218-c8bd21f60990 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:18.341859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8f5d5-7f88-4a9c-8218-c8bd21f60990 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:18.343498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3bc8f5d5-7f88-4a9c-8218-c8bd21f60990 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:18.439060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f5d5-7f88-4a9c-8218-c8bd21f60990 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:18.440665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8f5d5-7f88-4a9c-8218-c8bd21f60990 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:18.459759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 701/1419] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:19.351943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739883b-3c4c-4967-8240-40918fc67d65 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:19.352543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739883b-3c4c-4967-8240-40918fc67d65 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:19.352543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7739883b-3c4c-4967-8240-40918fc67d65 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:19.353841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:32:19.359347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b2ca-0115-4214-afcd-2b1084028573 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:19.359784 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b2ca-0115-4214-afcd-2b1084028573 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:19.359912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b2ca-0115-4214-afcd-2b1084028573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:19.414615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:19.438369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-24e7b2ca-0115-4214-afcd-2b1084028573 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:19.439599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24e7b2ca-0115-4214-afcd-2b1084028573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:19.538385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:19.691441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739883b-3c4c-4967-8240-40918fc67d65 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:19.692947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7739883b-3c4c-4967-8240-40918fc67d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:19.845898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7739883b-3c4c-4967-8240-40918fc67d65 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:19.858475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:19.961534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae02cfae-4530-49b7-8c54-d1449c8f7f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:19.962176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cfae-4530-49b7-8c54-d1449c8f7f9d service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:19.962481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cfae-4530-49b7-8c54-d1449c8f7f9d service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:19.962752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae02cfae-4530-49b7-8c54-d1449c8f7f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:19.964346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ae02cfae-4530-49b7-8c54-d1449c8f7f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:20.054410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02cfae-4530-49b7-8c54-d1449c8f7f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:20.056137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae02cfae-4530-49b7-8c54-d1449c8f7f9d service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:20.074434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 720/1422] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:20.949313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e13a-24fc-42b5-9df3-4dbebaa66f43 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:20.949866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e13a-24fc-42b5-9df3-4dbebaa66f43 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:20.949984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5332e13a-24fc-42b5-9df3-4dbebaa66f43 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:20.951426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:20.956445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef22b2-59af-4a24-9d08-6bcaded36d97 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:20.956862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef22b2-59af-4a24-9d08-6bcaded36d97 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:20.957006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef22b2-59af-4a24-9d08-6bcaded36d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:20.977341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:21.034683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-83ef22b2-59af-4a24-9d08-6bcaded36d97 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:21.035905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-83ef22b2-59af-4a24-9d08-6bcaded36d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:21.133211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:32:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:21.283759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e13a-24fc-42b5-9df3-4dbebaa66f43 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:21.285296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5332e13a-24fc-42b5-9df3-4dbebaa66f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:21.399539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:21.438086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5332e13a-24fc-42b5-9df3-4dbebaa66f43 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:21.550778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2781824-675a-4309-bec3-c07339f804fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:21.551306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781824-675a-4309-bec3-c07339f804fe service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:21.551590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781824-675a-4309-bec3-c07339f804fe service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:21.551871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2781824-675a-4309-bec3-c07339f804fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:21.553593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e2781824-675a-4309-bec3-c07339f804fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:21.631852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:21.646349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2781824-675a-4309-bec3-c07339f804fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:21.647948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2781824-675a-4309-bec3-c07339f804fe service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:21.668066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 704/1425] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:22.537434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2a794-77fd-423d-8c87-a641f0f9ab4d None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:22.538004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2a794-77fd-423d-8c87-a641f0f9ab4d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:22.538125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2a794-77fd-423d-8c87-a641f0f9ab4d None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:22.539418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:22.544637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c746f2-39af-4638-b3b3-ff1ce4c1fabf None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:22.545120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c746f2-39af-4638-b3b3-ff1ce4c1fabf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:22.545406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c746f2-39af-4638-b3b3-ff1ce4c1fabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:22.623851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-74c746f2-39af-4638-b3b3-ff1ce4c1fabf None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:22.625313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-74c746f2-39af-4638-b3b3-ff1ce4c1fabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:22.725439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:22.878172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2a794-77fd-423d-8c87-a641f0f9ab4d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:22.879780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ced2a794-77fd-423d-8c87-a641f0f9ab4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:22.965364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:23.029017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2a794-77fd-423d-8c87-a641f0f9ab4d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:23.149648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cde22c-6ae1-4ed7-944a-770cabadb867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:23.150284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde22c-6ae1-4ed7-944a-770cabadb867 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:23.150562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde22c-6ae1-4ed7-944a-770cabadb867 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:23.150830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cde22c-6ae1-4ed7-944a-770cabadb867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:23.152457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-25cde22c-6ae1-4ed7-944a-770cabadb867 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:23.200985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:23.242540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde22c-6ae1-4ed7-944a-770cabadb867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:23.244151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cde22c-6ae1-4ed7-944a-770cabadb867 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:23.262401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 723/1428] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:24.084290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bef4-f5ce-4948-8534-5a176938e5d6 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:24.084964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bef4-f5ce-4948-8534-5a176938e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:24.084964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366bef4-f5ce-4948-8534-5a176938e5d6 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:24.086225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:24.091290 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a690-9c9d-4645-9f58-ddec43154de3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:24.091759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a690-9c9d-4645-9f58-ddec43154de3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:24.092393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f9a690-9c9d-4645-9f58-ddec43154de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:24.169031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-86f9a690-9c9d-4645-9f58-ddec43154de3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:24.170980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-86f9a690-9c9d-4645-9f58-ddec43154de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:24.266632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:24.423194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366bef4-f5ce-4948-8534-5a176938e5d6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:24.424733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6366bef4-f5ce-4948-8534-5a176938e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:24.477138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:24.583335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366bef4-f5ce-4948-8534-5a176938e5d6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:24.700791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcf6de9-0413-46e8-9e92-8799e83040ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:24.701444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6de9-0413-46e8-9e92-8799e83040ca service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:24.701805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6de9-0413-46e8-9e92-8799e83040ca service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:24.702219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcf6de9-0413-46e8-9e92-8799e83040ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:24.704639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2dcf6de9-0413-46e8-9e92-8799e83040ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:24.712481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:24.799005 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf6de9-0413-46e8-9e92-8799e83040ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:24.800607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcf6de9-0413-46e8-9e92-8799e83040ca service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:24.818591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 707/1431] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:25.626267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ee84-44fc-4df6-b2a1-921e797749ee None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:25.626831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ee84-44fc-4df6-b2a1-921e797749ee None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:25.626946 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ee84-44fc-4df6-b2a1-921e797749ee None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:25.628405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:32:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:25.633613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75bdb8-cfd7-4872-b725-da096dff0fc6 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:25.634125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75bdb8-cfd7-4872-b725-da096dff0fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:25.634236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e75bdb8-cfd7-4872-b725-da096dff0fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:25.709852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7e75bdb8-cfd7-4872-b725-da096dff0fc6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:25.711100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7e75bdb8-cfd7-4872-b725-da096dff0fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:25.779477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:25.811823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:25.964578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ee84-44fc-4df6-b2a1-921e797749ee None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:25.966220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a1f9ee84-44fc-4df6-b2a1-921e797749ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:25.984148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:26.111531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ee84-44fc-4df6-b2a1-921e797749ee None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:26.199745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:26.227107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be7b2-35d5-46e9-ad67-8467dd78e212 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:26.227630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be7b2-35d5-46e9-ad67-8467dd78e212 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:26.227910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be7b2-35d5-46e9-ad67-8467dd78e212 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:26.228185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be7b2-35d5-46e9-ad67-8467dd78e212 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:26.229789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fa4be7b2-35d5-46e9-ad67-8467dd78e212 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:26.320017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be7b2-35d5-46e9-ad67-8467dd78e212 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:26.321546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be7b2-35d5-46e9-ad67-8467dd78e212 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:26.340696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 726/1434] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:27.204760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a271-bd7b-426f-8980-4f614d15f0df None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:27.205336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a271-bd7b-426f-8980-4f614d15f0df None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:27.205336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f527a271-bd7b-426f-8980-4f614d15f0df None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:27.206742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:32:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:27.211774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32f10-4416-459e-8bf8-feace37af485 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:27.212225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32f10-4416-459e-8bf8-feace37af485 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:27.212334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf32f10-4416-459e-8bf8-feace37af485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:27.291282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7bf32f10-4416-459e-8bf8-feace37af485 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:27.292751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7bf32f10-4416-459e-8bf8-feace37af485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:27.334506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:27.389450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:32:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:27.544874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527a271-bd7b-426f-8980-4f614d15f0df None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:27.546975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f527a271-bd7b-426f-8980-4f614d15f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:27.705304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f527a271-bd7b-426f-8980-4f614d15f0df None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:27.760651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:27.821521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a21e9a-a679-4b96-9cbe-0078421252f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:27.822256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a21e9a-a679-4b96-9cbe-0078421252f9 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:27.822779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a21e9a-a679-4b96-9cbe-0078421252f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:27.823291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a21e9a-a679-4b96-9cbe-0078421252f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:27.825041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-21a21e9a-a679-4b96-9cbe-0078421252f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:27.921193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a21e9a-a679-4b96-9cbe-0078421252f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:27.922824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a21e9a-a679-4b96-9cbe-0078421252f9 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:27.940719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 710/1437] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:28.774197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547ebe-9476-43b5-9b1d-c6eaee63dcab None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:28.774797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547ebe-9476-43b5-9b1d-c6eaee63dcab None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:28.774797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0547ebe-9476-43b5-9b1d-c6eaee63dcab None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:28.776106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:28.781766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af3927-ad71-4bff-97b0-2d6ee6ae9990 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:28.782278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af3927-ad71-4bff-97b0-2d6ee6ae9990 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:28.782405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af3927-ad71-4bff-97b0-2d6ee6ae9990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:28.872095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-24af3927-ad71-4bff-97b0-2d6ee6ae9990 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:28.873403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24af3927-ad71-4bff-97b0-2d6ee6ae9990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:28.876274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:28.981738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:32:29.135834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0547ebe-9476-43b5-9b1d-c6eaee63dcab None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:29.138030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b0547ebe-9476-43b5-9b1d-c6eaee63dcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:29.307409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0547ebe-9476-43b5-9b1d-c6eaee63dcab None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:29.335496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:29.434016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fba03d-1e41-4c44-9483-4306473fd2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:29.434542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba03d-1e41-4c44-9483-4306473fd2a2 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:29.434818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba03d-1e41-4c44-9483-4306473fd2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:29.435085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fba03d-1e41-4c44-9483-4306473fd2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:29.436709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-11fba03d-1e41-4c44-9483-4306473fd2a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:29.527409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba03d-1e41-4c44-9483-4306473fd2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:29.529018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fba03d-1e41-4c44-9483-4306473fd2a2 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:29.549360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 729/1440] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:31.404617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566c12-9758-4d21-ab89-6b34fad73bbf None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:31.405235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566c12-9758-4d21-ab89-6b34fad73bbf None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:31.405393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48566c12-9758-4d21-ab89-6b34fad73bbf None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:31.406653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:31.412032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240bbc-56fc-4c4f-8868-91335e25393b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:31.412496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240bbc-56fc-4c4f-8868-91335e25393b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:31.412763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4240bbc-56fc-4c4f-8868-91335e25393b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:31.454932 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:31.480205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c4240bbc-56fc-4c4f-8868-91335e25393b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:31.481421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c4240bbc-56fc-4c4f-8868-91335e25393b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:31.580156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:31.876609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566c12-9758-4d21-ab89-6b34fad73bbf None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:31.878186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-48566c12-9758-4d21-ab89-6b34fad73bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:31.981526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48566c12-9758-4d21-ab89-6b34fad73bbf None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:32.013193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:32.057019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a36da6-175e-49f1-8df9-12c5ea42baa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:32.057622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36da6-175e-49f1-8df9-12c5ea42baa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:32.057931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36da6-175e-49f1-8df9-12c5ea42baa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:32.058210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a36da6-175e-49f1-8df9-12c5ea42baa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:32.059810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a7a36da6-175e-49f1-8df9-12c5ea42baa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:32.170852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a36da6-175e-49f1-8df9-12c5ea42baa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:32.172217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a36da6-175e-49f1-8df9-12c5ea42baa0 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:32.191341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 713/1443] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:34.266274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332c34f-dbea-47a1-9f4c-5db01a53ab09 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:34.269042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332c34f-dbea-47a1-9f4c-5db01a53ab09 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:34.269042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f332c34f-dbea-47a1-9f4c-5db01a53ab09 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:34.269042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:34.275492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4ca1-b157-4826-aec2-a578777e68a6 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:34.275897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4ca1-b157-4826-aec2-a578777e68a6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:34.276048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db4ca1-b157-4826-aec2-a578777e68a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:34.343243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-45db4ca1-b157-4826-aec2-a578777e68a6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:34.344476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-45db4ca1-b157-4826-aec2-a578777e68a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:34.357416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:34.443797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:34.733694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332c34f-dbea-47a1-9f4c-5db01a53ab09 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:34.735444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f332c34f-dbea-47a1-9f4c-5db01a53ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:34.841254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f332c34f-dbea-47a1-9f4c-5db01a53ab09 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:34.854069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:34.915682 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d61e29-fc35-4415-a3f9-f1e3ec4d6a7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:34.916289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61e29-fc35-4415-a3f9-f1e3ec4d6a7c service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:34.916569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61e29-fc35-4415-a3f9-f1e3ec4d6a7c service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:34.916840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d61e29-fc35-4415-a3f9-f1e3ec4d6a7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:34.918721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c0d61e29-fc35-4415-a3f9-f1e3ec4d6a7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:35.032390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d61e29-fc35-4415-a3f9-f1e3ec4d6a7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:35.033831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d61e29-fc35-4415-a3f9-f1e3ec4d6a7c service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:35.051795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 732/1446] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:37.275600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b0b2a-3eba-4271-a8ad-86035bc077a3 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:37.276153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b0b2a-3eba-4271-a8ad-86035bc077a3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:37.276153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b0b2a-3eba-4271-a8ad-86035bc077a3 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:37.277479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:37.282873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2941-5f27-47c2-9f5e-af76607d7c5e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:37.283314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2941-5f27-47c2-9f5e-af76607d7c5e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:37.283410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e2941-5f27-47c2-9f5e-af76607d7c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:37.331935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:37.350618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-787e2941-5f27-47c2-9f5e-af76607d7c5e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:37.351852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-787e2941-5f27-47c2-9f5e-af76607d7c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:37.448242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:37.732247 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b0b2a-3eba-4271-a8ad-86035bc077a3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:37.735364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e95b0b2a-3eba-4271-a8ad-86035bc077a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:37.842105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b0b2a-3eba-4271-a8ad-86035bc077a3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:37.883463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:37.918599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72672371-4a87-47ca-bd01-b5f9b39360f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:37.919200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72672371-4a87-47ca-bd01-b5f9b39360f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:37.919484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72672371-4a87-47ca-bd01-b5f9b39360f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:37.919753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72672371-4a87-47ca-bd01-b5f9b39360f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:37.921842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-72672371-4a87-47ca-bd01-b5f9b39360f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:38.030585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72672371-4a87-47ca-bd01-b5f9b39360f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:38.032062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72672371-4a87-47ca-bd01-b5f9b39360f3 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:38.051375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 716/1449] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:40.084810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5283-8a96-4052-ae42-a70f24d39efb None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:40.085386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5283-8a96-4052-ae42-a70f24d39efb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:40.085386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b5283-8a96-4052-ae42-a70f24d39efb None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:40.086764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:40.092438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6653-7c8c-4d3d-ace3-e2e73c0063b0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:40.093456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6653-7c8c-4d3d-ace3-e2e73c0063b0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:40.093456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ea6653-7c8c-4d3d-ace3-e2e73c0063b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:40.158582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-15ea6653-7c8c-4d3d-ace3-e2e73c0063b0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:40.159792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-15ea6653-7c8c-4d3d-ace3-e2e73c0063b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:40.181481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:40.261983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:40.546995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5283-8a96-4052-ae42-a70f24d39efb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:40.548532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-915b5283-8a96-4052-ae42-a70f24d39efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:40.658346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b5283-8a96-4052-ae42-a70f24d39efb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:40.679286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:40.735807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c37bb-de01-40e2-9552-61bb4d80d12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:40.736427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c37bb-de01-40e2-9552-61bb4d80d12d service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:40.736715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c37bb-de01-40e2-9552-61bb4d80d12d service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:40.736989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c37bb-de01-40e2-9552-61bb4d80d12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:40.738665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8b9c37bb-de01-40e2-9552-61bb4d80d12d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:40.851365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c37bb-de01-40e2-9552-61bb4d80d12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:40.852823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c37bb-de01-40e2-9552-61bb4d80d12d service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:40.871270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 735/1452] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:42.832728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e03036-924c-422e-994a-d97cf0792576 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:42.833282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e03036-924c-422e-994a-d97cf0792576 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:42.833282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e03036-924c-422e-994a-d97cf0792576 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:42.834642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:42.840071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b544d-8d53-45a7-854c-5ffcacf5f6c4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:42.840547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b544d-8d53-45a7-854c-5ffcacf5f6c4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:42.840668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b544d-8d53-45a7-854c-5ffcacf5f6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:42.907986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:42.910877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b07b544d-8d53-45a7-854c-5ffcacf5f6c4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:42.912805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b07b544d-8d53-45a7-854c-5ffcacf5f6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:43.010898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:43.295222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e03036-924c-422e-994a-d97cf0792576 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:43.296877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c3e03036-924c-422e-994a-d97cf0792576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:43.400460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e03036-924c-422e-994a-d97cf0792576 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:43.449496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:43.474938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231a91f-de2b-4c80-ba7c-3d5bda9c24df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:43.475542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a91f-de2b-4c80-ba7c-3d5bda9c24df service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:43.475821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a91f-de2b-4c80-ba7c-3d5bda9c24df service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:43.476090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231a91f-de2b-4c80-ba7c-3d5bda9c24df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:43.477720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f231a91f-de2b-4c80-ba7c-3d5bda9c24df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:43.587417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231a91f-de2b-4c80-ba7c-3d5bda9c24df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:43.588851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231a91f-de2b-4c80-ba7c-3d5bda9c24df service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:43.607352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 719/1455] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:45.570100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40878830-8402-435e-b2ed-2f49dfbcb51d None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:45.570680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40878830-8402-435e-b2ed-2f49dfbcb51d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:45.570680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40878830-8402-435e-b2ed-2f49dfbcb51d None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:45.572040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:45.578298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863126f2-c80f-41c9-a951-2775a804aaee None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:45.578715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863126f2-c80f-41c9-a951-2775a804aaee None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:45.578847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863126f2-c80f-41c9-a951-2775a804aaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:45.663173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-863126f2-c80f-41c9-a951-2775a804aaee None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:45.664408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-863126f2-c80f-41c9-a951-2775a804aaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:45.700718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:45.773016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:46.066154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40878830-8402-435e-b2ed-2f49dfbcb51d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:46.067701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-40878830-8402-435e-b2ed-2f49dfbcb51d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:46.173949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40878830-8402-435e-b2ed-2f49dfbcb51d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:46.203270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:46.250092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610db332-07a3-4f1f-a03b-1ebaae0f5508 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:46.250706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db332-07a3-4f1f-a03b-1ebaae0f5508 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:46.250987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db332-07a3-4f1f-a03b-1ebaae0f5508 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:46.251259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610db332-07a3-4f1f-a03b-1ebaae0f5508 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:46.252843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-610db332-07a3-4f1f-a03b-1ebaae0f5508 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:46.362986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610db332-07a3-4f1f-a03b-1ebaae0f5508 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:46.364446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610db332-07a3-4f1f-a03b-1ebaae0f5508 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:46.382929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 738/1458] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:48.615569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac55af-82fb-4db2-a856-9397994c0567 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:48.616112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac55af-82fb-4db2-a856-9397994c0567 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:48.616112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac55af-82fb-4db2-a856-9397994c0567 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:48.617496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:32:48.623178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb36a51-a10b-4201-9cbe-e6f81e545f9c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:48.623645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb36a51-a10b-4201-9cbe-e6f81e545f9c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:48.623780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb36a51-a10b-4201-9cbe-e6f81e545f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:48.692586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8cb36a51-a10b-4201-9cbe-e6f81e545f9c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:48.693730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8cb36a51-a10b-4201-9cbe-e6f81e545f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:48.703210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:48.809147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:49.094146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac55af-82fb-4db2-a856-9397994c0567 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:49.095670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-25ac55af-82fb-4db2-a856-9397994c0567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:49.200767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac55af-82fb-4db2-a856-9397994c0567 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:49.257868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:49.276480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af8bc6-3723-40a4-abb3-b59b13c5f074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:49.277090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8bc6-3723-40a4-abb3-b59b13c5f074 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:49.277374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8bc6-3723-40a4-abb3-b59b13c5f074 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:49.277651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af8bc6-3723-40a4-abb3-b59b13c5f074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:49.279332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-83af8bc6-3723-40a4-abb3-b59b13c5f074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:49.388157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af8bc6-3723-40a4-abb3-b59b13c5f074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:49.389544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af8bc6-3723-40a4-abb3-b59b13c5f074 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:49.408353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 722/1461] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:51.381847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2db16-4f5d-4f76-8b13-e6c29faed456 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:51.382433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2db16-4f5d-4f76-8b13-e6c29faed456 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:51.382433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2db16-4f5d-4f76-8b13-e6c29faed456 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:51.383810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:51.390295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8d2d-f98c-498a-9b37-9bff0a70c256 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:51.390766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8d2d-f98c-498a-9b37-9bff0a70c256 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:51.391036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d8d2d-f98c-498a-9b37-9bff0a70c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:51.461352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a94d8d2d-f98c-498a-9b37-9bff0a70c256 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:51.462622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a94d8d2d-f98c-498a-9b37-9bff0a70c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:51.502308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:51.562719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:51.853321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2db16-4f5d-4f76-8b13-e6c29faed456 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:51.854896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bcc2db16-4f5d-4f76-8b13-e6c29faed456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:51.958481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2db16-4f5d-4f76-8b13-e6c29faed456 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:51.997618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:52.035002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e75701b-e81c-4775-b94a-07e8b6dbcbcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:52.035617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75701b-e81c-4775-b94a-07e8b6dbcbcf service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:52.035901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75701b-e81c-4775-b94a-07e8b6dbcbcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:52.036178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e75701b-e81c-4775-b94a-07e8b6dbcbcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:52.037789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3e75701b-e81c-4775-b94a-07e8b6dbcbcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:52.150327 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75701b-e81c-4775-b94a-07e8b6dbcbcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:52.151686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e75701b-e81c-4775-b94a-07e8b6dbcbcf service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:52.170937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 741/1464] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:54.123760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149868aa-c763-426d-b8e3-516fe4d78012 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:54.124843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149868aa-c763-426d-b8e3-516fe4d78012 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:54.124843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149868aa-c763-426d-b8e3-516fe4d78012 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:54.126136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:54.131421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faae3cb-0c9b-46d6-8fea-e1ce49bd18dc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:54.131822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faae3cb-0c9b-46d6-8fea-e1ce49bd18dc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:54.131975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faae3cb-0c9b-46d6-8fea-e1ce49bd18dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:54.198907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8faae3cb-0c9b-46d6-8fea-e1ce49bd18dc None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:54.200113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8faae3cb-0c9b-46d6-8fea-e1ce49bd18dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:54.217739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:54.297834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:54.591828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149868aa-c763-426d-b8e3-516fe4d78012 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:54.594068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-149868aa-c763-426d-b8e3-516fe4d78012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:54.701940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149868aa-c763-426d-b8e3-516fe4d78012 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:54.770909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:54.778404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813a777-7840-48f4-8f3f-7ce5f9fd343c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:54.779031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813a777-7840-48f4-8f3f-7ce5f9fd343c service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:54.779476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813a777-7840-48f4-8f3f-7ce5f9fd343c service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:54.779783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813a777-7840-48f4-8f3f-7ce5f9fd343c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:54.782044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e813a777-7840-48f4-8f3f-7ce5f9fd343c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:54.897192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813a777-7840-48f4-8f3f-7ce5f9fd343c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:54.898805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813a777-7840-48f4-8f3f-7ce5f9fd343c service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:54.917478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 725/1467] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:32:56.867220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a368-e124-4974-9a89-6a34662592ee None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:56.867954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a368-e124-4974-9a89-6a34662592ee None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:56.867954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b588a368-e124-4974-9a89-6a34662592ee None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:56.869126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:32:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:32:56.875044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016b73-edde-41b7-8724-d4040ec6c3da None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:56.875531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016b73-edde-41b7-8724-d4040ec6c3da None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:56.875650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99016b73-edde-41b7-8724-d4040ec6c3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:56.942164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-99016b73-edde-41b7-8724-d4040ec6c3da None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:32:56.943385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-99016b73-edde-41b7-8724-d4040ec6c3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:56.992342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:57.041296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:32:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:32:57.329508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588a368-e124-4974-9a89-6a34662592ee None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:32:57.331147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b588a368-e124-4974-9a89-6a34662592ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:57.437556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b588a368-e124-4974-9a89-6a34662592ee None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:32:57.485227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:32:57.512256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46db26-9dfd-4f0a-b7d8-fd962590fea5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:32:57.512865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46db26-9dfd-4f0a-b7d8-fd962590fea5 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:32:57.513151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46db26-9dfd-4f0a-b7d8-fd962590fea5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:32:57.513425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46db26-9dfd-4f0a-b7d8-fd962590fea5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:32:57.515095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6c46db26-9dfd-4f0a-b7d8-fd962590fea5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:32:57.626629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46db26-9dfd-4f0a-b7d8-fd962590fea5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:32:57.628074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46db26-9dfd-4f0a-b7d8-fd962590fea5 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:32:57.646821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 744/1470] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:32:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:33:07.039485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=22 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:07.644376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=66 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:17.236741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a94f-9d26-476c-95eb-159b94de61f4 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:17.237295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a94f-9d26-476c-95eb-159b94de61f4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:17.237295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a94f-9d26-476c-95eb-159b94de61f4 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:17.238691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 727/1471] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:33:17.244019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e604-fc20-4bcc-bd70-658004b4dc41 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:17.244498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e604-fc20-4bcc-bd70-658004b4dc41 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:17.244606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c57e604-fc20-4bcc-bd70-658004b4dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:17.312535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5c57e604-fc20-4bcc-bd70-658004b4dc41 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:33:17.313972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5c57e604-fc20-4bcc-bd70-658004b4dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:17.411086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 745/1472] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:33:17.705833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e4332-6a5e-42f4-ae94-9e63f80ada3d None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:17.706152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e4332-6a5e-42f4-ae94-9e63f80ada3d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:17.706428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e4332-6a5e-42f4-ae94-9e63f80ada3d None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:17.707766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 728/1473] 10.222.0.88 () {54 vars in 967 bytes} [Fri Aug 26 00:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:33:17.712722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a673d79-f362-40dc-acb5-9af9bc406a74 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:17.713011 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a673d79-f362-40dc-acb5-9af9bc406a74 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:17.713296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a673d79-f362-40dc-acb5-9af9bc406a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:17.791421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4a673d79-f362-40dc-acb5-9af9bc406a74 None None] MFA Rules not processed for user `2be2cb98356b4d628408d094589a83e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:33:17.792640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4a673d79-f362-40dc-acb5-9af9bc406a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:17.818887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:17.878363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 746/1474] 10.222.0.88 () {58 vars in 1064 bytes} [Fri Aug 26 00:33:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:33:17.885919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e4332-6a5e-42f4-ae94-9e63f80ada3d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:33:17.887456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e34e4332-6a5e-42f4-ae94-9e63f80ada3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:18.003412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e4332-6a5e-42f4-ae94-9e63f80ada3d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:33:18.078903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed531c9-909e-4897-b353-e8485bda7366 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be2cb98356b4d628408d094589a83e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:33:18.079512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed531c9-909e-4897-b353-e8485bda7366 service glance] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:18.079793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed531c9-909e-4897-b353-e8485bda7366 service glance] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:18.080063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed531c9-909e-4897-b353-e8485bda7366 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:18.081699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fed531c9-909e-4897-b353-e8485bda7366 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:18.142363 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:18.200866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed531c9-909e-4897-b353-e8485bda7366 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:33:18.202337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed531c9-909e-4897-b353-e8485bda7366 service glance] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:33:18.225840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 729/1475] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:33:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:33:20.234680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3538-b4b0-4bcb-9e8c-8a513db7ccf9 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:20.235458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3538-b4b0-4bcb-9e8c-8a513db7ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:20.235458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c3538-b4b0-4bcb-9e8c-8a513db7ccf9 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:20.236666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 747/1476] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:33:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:33:20.241893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288ee8c-a529-43ec-b3e2-d64e846cee54 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:20.242306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288ee8c-a529-43ec-b3e2-d64e846cee54 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:20.242453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6288ee8c-a529-43ec-b3e2-d64e846cee54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:20.308736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6288ee8c-a529-43ec-b3e2-d64e846cee54 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:33:20.309980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6288ee8c-a529-43ec-b3e2-d64e846cee54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:20.407198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 730/1477] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:33:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:33:20.686003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c3538-b4b0-4bcb-9e8c-8a513db7ccf9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:33:20.688426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-844c3538-b4b0-4bcb-9e8c-8a513db7ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:20.835227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c3538-b4b0-4bcb-9e8c-8a513db7ccf9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:33:20.883692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:20.929929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e967350-9fb8-4e32-8e2b-3117c6e7be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:33:20.930512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e967350-9fb8-4e32-8e2b-3117c6e7be05 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:20.930792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e967350-9fb8-4e32-8e2b-3117c6e7be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:20.931067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e967350-9fb8-4e32-8e2b-3117c6e7be05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:20.931705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e967350-9fb8-4e32-8e2b-3117c6e7be05 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:33:20.933500 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-1e967350-9fb8-4e32-8e2b-3117c6e7be05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:33:20.933500 dv-cinder-835384-25-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 26 00:33:20.933500 dv-cinder-835384-25-smb devstack@keystone.service[81539]: Aug 26 00:33:20.934677 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e967350-9fb8-4e32-8e2b-3117c6e7be05 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:33:20.954067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 748/1478] 10.222.0.88 () {56 vars in 1108 bytes} [Fri Aug 26 00:33:20 2022] GET /identity/v3/projects => generated 2553 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:33:22.880716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e2ee-ad6a-4e8a-bc06-fef703f8b70c None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:22.881298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e2ee-ad6a-4e8a-bc06-fef703f8b70c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:22.881298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4e2ee-ad6a-4e8a-bc06-fef703f8b70c None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:22.882666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 731/1479] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:33:22.888066 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026b72-9200-4af7-be7b-02053ebb8d10 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:22.888521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026b72-9200-4af7-be7b-02053ebb8d10 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:22.888632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d026b72-9200-4af7-be7b-02053ebb8d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:22.957566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0d026b72-9200-4af7-be7b-02053ebb8d10 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:33:22.958972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0d026b72-9200-4af7-be7b-02053ebb8d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:23.056575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 749/1480] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:33:23.358682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e2ee-ad6a-4e8a-bc06-fef703f8b70c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:33:23.361014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7fa4e2ee-ad6a-4e8a-bc06-fef703f8b70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:23.370977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:23.506396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4e2ee-ad6a-4e8a-bc06-fef703f8b70c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:33:23.587968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:23.621786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4887b9-4987-48e9-a4fc-5488dd36b250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:33:23.622344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4887b9-4987-48e9-a4fc-5488dd36b250 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:23.622628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4887b9-4987-48e9-a4fc-5488dd36b250 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:23.622905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4887b9-4987-48e9-a4fc-5488dd36b250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:23.625115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bc4887b9-4987-48e9-a4fc-5488dd36b250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:23.715610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4887b9-4987-48e9-a4fc-5488dd36b250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:33:23.717203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4887b9-4987-48e9-a4fc-5488dd36b250 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:33:23.735407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 732/1481] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:33:25.887948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a7e89-fda1-41fe-b51e-3e58ab850c1a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:25.888522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a7e89-fda1-41fe-b51e-3e58ab850c1a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:25.888522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a7e89-fda1-41fe-b51e-3e58ab850c1a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:25.889800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 750/1482] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:33:25.895716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235d0e-02ad-482a-9848-16d887653aff None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:25.896189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235d0e-02ad-482a-9848-16d887653aff None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:25.896315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e235d0e-02ad-482a-9848-16d887653aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:25.964624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1e235d0e-02ad-482a-9848-16d887653aff None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:33:25.965853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1e235d0e-02ad-482a-9848-16d887653aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:26.013375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:26.065613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 733/1483] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:33:26.372325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a7e89-fda1-41fe-b51e-3e58ab850c1a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:33:26.373898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e22a7e89-fda1-41fe-b51e-3e58ab850c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:26.398960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:26.484715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a7e89-fda1-41fe-b51e-3e58ab850c1a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:33:26.561082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe5191-8252-4b88-aee8-ed0ec0f9c77a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:33:26.561698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe5191-8252-4b88-aee8-ed0ec0f9c77a service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:26.562026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe5191-8252-4b88-aee8-ed0ec0f9c77a service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:26.562842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe5191-8252-4b88-aee8-ed0ec0f9c77a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:26.564551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5abe5191-8252-4b88-aee8-ed0ec0f9c77a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:26.644387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:26.692087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe5191-8252-4b88-aee8-ed0ec0f9c77a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:33:26.693557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe5191-8252-4b88-aee8-ed0ec0f9c77a service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:33:26.713083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 751/1484] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:33:28.706145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8db088-7569-4083-a021-4733cc6df429 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:28.706758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8db088-7569-4083-a021-4733cc6df429 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:28.706758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8db088-7569-4083-a021-4733cc6df429 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:28.708050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 734/1485] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:33:28.713461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dac4-e21d-4df1-b548-2c6e3c1d0201 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:28.713956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dac4-e21d-4df1-b548-2c6e3c1d0201 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:28.714112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626dac4-e21d-4df1-b548-2c6e3c1d0201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:28.789021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b626dac4-e21d-4df1-b548-2c6e3c1d0201 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:33:28.790293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b626dac4-e21d-4df1-b548-2c6e3c1d0201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:28.894319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 752/1486] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:33:29.185928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8db088-7569-4083-a021-4733cc6df429 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:33:29.187668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9f8db088-7569-4083-a021-4733cc6df429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:29.302377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8db088-7569-4083-a021-4733cc6df429 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:33:29.392238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:29.394311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3192091-5eeb-41eb-9644-f93851458f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:33:29.395093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3192091-5eeb-41eb-9644-f93851458f45 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:29.395577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3192091-5eeb-41eb-9644-f93851458f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:29.395903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3192091-5eeb-41eb-9644-f93851458f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:29.397891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f3192091-5eeb-41eb-9644-f93851458f45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:29.511174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3192091-5eeb-41eb-9644-f93851458f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:33:29.512616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3192091-5eeb-41eb-9644-f93851458f45 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:33:29.531836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 735/1487] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:33:31.607280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee3861-1dd8-4f8d-bc5c-b2c492420bc9 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:31.607827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee3861-1dd8-4f8d-bc5c-b2c492420bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:31.607827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee3861-1dd8-4f8d-bc5c-b2c492420bc9 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:31.609193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 753/1488] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:33:31.614714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c54bf-668a-49a1-911a-92b640895214 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:31.615146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c54bf-668a-49a1-911a-92b640895214 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:31.615260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c54bf-668a-49a1-911a-92b640895214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:31.682176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-230c54bf-668a-49a1-911a-92b640895214 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:33:31.683393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-230c54bf-668a-49a1-911a-92b640895214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:31.737443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:31.782445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 736/1489] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:33:32.072395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee3861-1dd8-4f8d-bc5c-b2c492420bc9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:33:32.074051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cbee3861-1dd8-4f8d-bc5c-b2c492420bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:32.110825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:32.180179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee3861-1dd8-4f8d-bc5c-b2c492420bc9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:33:32.253414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e456b644-10eb-4573-958a-8e5c0889bcc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:33:32.254056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b644-10eb-4573-958a-8e5c0889bcc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:32.254343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b644-10eb-4573-958a-8e5c0889bcc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:32.254626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e456b644-10eb-4573-958a-8e5c0889bcc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:32.256230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e456b644-10eb-4573-958a-8e5c0889bcc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:32.337011 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:32.366042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456b644-10eb-4573-958a-8e5c0889bcc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:33:32.367491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e456b644-10eb-4573-958a-8e5c0889bcc4 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:33:32.385076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 754/1490] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:33:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:33:34.592922 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be482-532c-4b3e-9692-5c6af6b1b805 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:34.593372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be482-532c-4b3e-9692-5c6af6b1b805 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:34.593510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1be482-532c-4b3e-9692-5c6af6b1b805 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:34.595528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 737/1491] 10.222.0.88 () {54 vars in 927 bytes} [Fri Aug 26 00:33:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:33:34.600925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cab414-538d-4bfa-881d-ea01e7587270 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:34.601392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cab414-538d-4bfa-881d-ea01e7587270 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:34.601506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cab414-538d-4bfa-881d-ea01e7587270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:34.672613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a5cab414-538d-4bfa-881d-ea01e7587270 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:33:34.673836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a5cab414-538d-4bfa-881d-ea01e7587270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:34.771827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 755/1492] 10.222.0.88 () {58 vars in 1024 bytes} [Fri Aug 26 00:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:33:35.061672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1be482-532c-4b3e-9692-5c6af6b1b805 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:33:35.063864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ca1be482-532c-4b3e-9692-5c6af6b1b805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:35.167841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1be482-532c-4b3e-9692-5c6af6b1b805 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:33:35.240712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d27d59-cade-4ae9-a591-86f6d21cf59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:33:35.241309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27d59-cade-4ae9-a591-86f6d21cf59b service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:33:35.241588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27d59-cade-4ae9-a591-86f6d21cf59b service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:33:35.241863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d27d59-cade-4ae9-a591-86f6d21cf59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:33:35.243482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c0d27d59-cade-4ae9-a591-86f6d21cf59b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:33:35.253186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:35.353424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d27d59-cade-4ae9-a591-86f6d21cf59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:33:35.354807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d27d59-cade-4ae9-a591-86f6d21cf59b service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:33:35.373769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 738/1493] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:33:44.770060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=82 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:33:45.371354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=50 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:48.291078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f18a9-72e5-4871-940f-b1a64880b0d9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:48.291687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f18a9-72e5-4871-940f-b1a64880b0d9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:48.291687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f18a9-72e5-4871-940f-b1a64880b0d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:48.368704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b94f18a9-72e5-4871-940f-b1a64880b0d9 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:34:48.370065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b94f18a9-72e5-4871-940f-b1a64880b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:48.469439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 756/1494] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:34:48.477780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a050990-c447-43ab-87af-7ae58eca3eca None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:48.478404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a050990-c447-43ab-87af-7ae58eca3eca None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:48.478404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a050990-c447-43ab-87af-7ae58eca3eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:48.564705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9a050990-c447-43ab-87af-7ae58eca3eca None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:34:48.565901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9a050990-c447-43ab-87af-7ae58eca3eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:48.664697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 739/1495] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:34:48.669540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f18a9-72e5-4871-940f-b1a64880b0d9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:48.670809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b94f18a9-72e5-4871-940f-b1a64880b0d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:48.683702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f18a9-72e5-4871-940f-b1a64880b0d9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:48.745928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:48.780842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:48.781549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:48.781856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:48.782152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:48.782793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:34:48.783093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:48.784111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:34:48.784111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 26 00:34:48.784111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: Aug 26 00:34:48.784992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:48.796842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 757/1496] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:34:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:34:48.805819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a050990-c447-43ab-87af-7ae58eca3eca None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:48.815806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a050990-c447-43ab-87af-7ae58eca3eca None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:48.881422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:48.915028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:48.915637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:48.915918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:48.916196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:48.916825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:48.918626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:34:48.918626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 26 00:34:48.918626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: Aug 26 00:34:48.919869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:48.977066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 740/1497] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:34:48 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:34:48.981090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:48.982684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:49.018755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7c55f-80e4-46f3-b0ca-173076d82867 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:49.114890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:49.115407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:49.115689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:49.115957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:49.116581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:49.117591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:34:49.117591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 26 00:34:49.117591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: Aug 26 00:34:49.118907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:49.161936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 758/1498] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:34:48 2022] POST /identity/v3/users => generated 290 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:34:49.165990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:49.167495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:49.230420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e410da-87b9-4421-98de-e43930897bcb admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:49.315946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:49.327172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:49.327782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:49.328065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:49.328368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:49.329045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:49.330096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:34:49.330096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 26 00:34:49.330096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: Aug 26 00:34:49.330995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:49.345218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 741/1499] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:34:49.349291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:49.350850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:49.363364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16009a18-7da4-4dcf-9bee-6e6ef3ac5bcf admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:49.387960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:49.460940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266283d3-3bf3-47d4-ba85-1cc07aedf4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:49.461555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266283d3-3bf3-47d4-ba85-1cc07aedf4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:49.461954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266283d3-3bf3-47d4-ba85-1cc07aedf4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:49.462238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266283d3-3bf3-47d4-ba85-1cc07aedf4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:49.462885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266283d3-3bf3-47d4-ba85-1cc07aedf4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:49.463908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-266283d3-3bf3-47d4-ba85-1cc07aedf4ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:34:49.463908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 26 00:34:49.463908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: Aug 26 00:34:49.464808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266283d3-3bf3-47d4-ba85-1cc07aedf4ba admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:49.478126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 759/1500] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:34:49 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:34:49.482308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:49.483832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:49.517664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef520cd-e5d4-418f-9890-3a5d0a5634b8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:49.617178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0814a-5ffa-46d0-a9a4-4a1d71961d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:49.617847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0814a-5ffa-46d0-a9a4-4a1d71961d95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:49.618165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0814a-5ffa-46d0-a9a4-4a1d71961d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:49.618789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0814a-5ffa-46d0-a9a4-4a1d71961d95 admin admin] PATH_INFO: `/v3/projects/334d712fa77b47baac7a8ada94e540be/users/3d44f6de86f5410d8373a00048e2ed77/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:49.643405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0814a-5ffa-46d0-a9a4-4a1d71961d95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334d712fa77b47baac7a8ada94e540be, user_id=3d44f6de86f5410d8373a00048e2ed77, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:49.644371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-cdd0814a-5ffa-46d0-a9a4-4a1d71961d95 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:34:49.644371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 26 00:34:49.644371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: Aug 26 00:34:49.646391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0814a-5ffa-46d0-a9a4-4a1d71961d95 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:49.672148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 742/1501] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:34:49 2022] PUT /identity/v3/projects/334d712fa77b47baac7a8ada94e540be/users/3d44f6de86f5410d8373a00048e2ed77/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:34:49.684424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7da3-8a99-45d7-b93e-183355aa0aef None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:49.684709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7da3-8a99-45d7-b93e-183355aa0aef None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:49.684982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d7da3-8a99-45d7-b93e-183355aa0aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:49.741858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7f5d7da3-8a99-45d7-b93e-183355aa0aef None None] MFA Rules not processed for user `3d44f6de86f5410d8373a00048e2ed77`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:34:49.743098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7f5d7da3-8a99-45d7-b93e-183355aa0aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:49.822411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 760/1502] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:34:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:34:49.838918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993207b-a398-42ef-b413-9cece59c0b77 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:49.839231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993207b-a398-42ef-b413-9cece59c0b77 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:49.839512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2993207b-a398-42ef-b413-9cece59c0b77 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:49.840914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 743/1503] 10.222.0.88 () {54 vars in 964 bytes} [Fri Aug 26 00:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:34:49.846197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701232d-2056-42c2-8ce6-8183204caf58 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:49.846493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701232d-2056-42c2-8ce6-8183204caf58 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:49.846777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701232d-2056-42c2-8ce6-8183204caf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:49.880662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:49.926955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c701232d-2056-42c2-8ce6-8183204caf58 None None] MFA Rules not processed for user `a0d14a63f09046efb6d5c2533f6d3609`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:34:49.928089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c701232d-2056-42c2-8ce6-8183204caf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:50.004805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 761/1504] 10.222.0.88 () {58 vars in 1061 bytes} [Fri Aug 26 00:34:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:34:50.012539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993207b-a398-42ef-b413-9cece59c0b77 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:50.014079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2993207b-a398-42ef-b413-9cece59c0b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:50.065546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:50.119460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2993207b-a398-42ef-b413-9cece59c0b77 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:50.192756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:50.193288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:50.193567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:50.193838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:50.195450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:50.293207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:50.294669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:50.298950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:50.314487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 744/1505] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:34:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:34:50.359948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990993e-3e29-4052-9eeb-8d5a3e1fff83 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:50.360366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990993e-3e29-4052-9eeb-8d5a3e1fff83 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:50.360521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990993e-3e29-4052-9eeb-8d5a3e1fff83 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:50.361754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 762/1506] 10.222.0.88 () {52 vars in 830 bytes} [Fri Aug 26 00:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:34:50.365323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:50.366586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:50.472428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94b37d-9c34-491e-a961-c002c4250ab8 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:50.568989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:50.569647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:50.569921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:50.573464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] PATH_INFO: `/v3/users/3d44f6de86f5410d8373a00048e2ed77` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:50.584180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d44f6de86f5410d8373a00048e2ed77)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:50.585216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:34:50.585216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 26 00:34:50.585216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: Aug 26 00:34:50.586493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:50.597026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:50.657341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d44f6de86f5410d8373a00048e2ed77'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:50.681848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d44f6de86f5410d8373a00048e2ed77'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:50.682437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d44f6de86f5410d8373a00048e2ed77'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:50.691911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d44f6de86f5410d8373a00048e2ed77'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:50.706521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d44f6de86f5410d8373a00048e2ed77'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:50.712003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 745/1507] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:34:50 2022] DELETE /identity/v3/users/3d44f6de86f5410d8373a00048e2ed77 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:34:50.716411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad248a-51f3-49ed-8552-5472f073c131 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:50.716705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad248a-51f3-49ed-8552-5472f073c131 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:50.716990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad248a-51f3-49ed-8552-5472f073c131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:50.776654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ddad248a-51f3-49ed-8552-5472f073c131 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:34:50.777905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ddad248a-51f3-49ed-8552-5472f073c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:50.855807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:50.869762 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 763/1508] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:34:50.879356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:50.880754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:50.984019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9713cfc-f21e-476d-9f01-1bf3d48a9a29 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:51.038939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:34:51.059668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81eb7aa-21d3-4f29-a2de-2747db64219b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:51.060294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eb7aa-21d3-4f29-a2de-2747db64219b service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:51.060554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eb7aa-21d3-4f29-a2de-2747db64219b service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:51.060825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81eb7aa-21d3-4f29-a2de-2747db64219b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:51.062468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e81eb7aa-21d3-4f29-a2de-2747db64219b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:51.170469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81eb7aa-21d3-4f29-a2de-2747db64219b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:51.172789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81eb7aa-21d3-4f29-a2de-2747db64219b service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:51.191974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 746/1509] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:34:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:34:51.638547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad248a-51f3-49ed-8552-5472f073c131 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:34:51.639790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ddad248a-51f3-49ed-8552-5472f073c131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:34:51.652080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad248a-51f3-49ed-8552-5472f073c131 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:34:51.749520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:34:51.750571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:34:51.750861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:34:51.751163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] PATH_INFO: `/v3/projects/334d712fa77b47baac7a8ada94e540be` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:34:51.761571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334d712fa77b47baac7a8ada94e540be)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:34:51.762656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:34:51.762656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 26 00:34:51.762656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: Aug 26 00:34:51.763888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:34:51.824842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334d712fa77b47baac7a8ada94e540be', 'request_id': 'req-9a6df589-7861-48b1-aca0-9f2328376dc4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:51.831940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334d712fa77b47baac7a8ada94e540be', 'request_id': 'req-9a6df589-7861-48b1-aca0-9f2328376dc4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:51.841984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334d712fa77b47baac7a8ada94e540be', 'request_id': 'req-9a6df589-7861-48b1-aca0-9f2328376dc4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:51.993379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] The token cache is being invalidate because project 334d712fa77b47baac7a8ada94e540be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:34:51.993667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:51.994231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9a6df589-7861-48b1-aca0-9f2328376dc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:34:51.995534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 764/1510] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:34:51 2022] DELETE /identity/v3/projects/334d712fa77b47baac7a8ada94e540be => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:35:01.189674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=62 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:35:01.991166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:36:27.944159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700c9c-f7ea-4880-b318-555afbf700f7 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:27.944727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700c9c-f7ea-4880-b318-555afbf700f7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:27.944727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b700c9c-f7ea-4880-b318-555afbf700f7 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:27.946078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:36:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:27.951309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bdc04-cfa8-492c-9f48-f67ad1eece52 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:27.951761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bdc04-cfa8-492c-9f48-f67ad1eece52 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:27.951870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5bdc04-cfa8-492c-9f48-f67ad1eece52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:28.033325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ae5bdc04-cfa8-492c-9f48-f67ad1eece52 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:28.035197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ae5bdc04-cfa8-492c-9f48-f67ad1eece52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:28.136869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:36:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:28.298019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700c9c-f7ea-4880-b318-555afbf700f7 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:28.300186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7b700c9c-f7ea-4880-b318-555afbf700f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:28.419744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b700c9c-f7ea-4880-b318-555afbf700f7 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:28.425469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd1e31-8341-4bd0-908a-1f4a2af63a7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:28.426103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd1e31-8341-4bd0-908a-1f4a2af63a7c service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:28.426383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd1e31-8341-4bd0-908a-1f4a2af63a7c service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:28.426656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd1e31-8341-4bd0-908a-1f4a2af63a7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:28.435758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd1e31-8341-4bd0-908a-1f4a2af63a7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:28.437385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd1e31-8341-4bd0-908a-1f4a2af63a7c service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:28.447951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 748/1513] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:36:29.275698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4befb0-8b75-4878-9037-5addf1ec5d56 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:29.276302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4befb0-8b75-4878-9037-5addf1ec5d56 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:29.276302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4befb0-8b75-4878-9037-5addf1ec5d56 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:29.277585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:29.282466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337855fd-246d-4c2d-afd8-2f5eed3ad282 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:29.282936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337855fd-246d-4c2d-afd8-2f5eed3ad282 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:29.283045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337855fd-246d-4c2d-afd8-2f5eed3ad282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:29.303919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-337855fd-246d-4c2d-afd8-2f5eed3ad282 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:29.305116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-337855fd-246d-4c2d-afd8-2f5eed3ad282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:29.313027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:36:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:29.430139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d9fc-00f6-4cad-8017-5c294d40fec4 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:29.430426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d9fc-00f6-4cad-8017-5c294d40fec4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:29.430704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2d9fc-00f6-4cad-8017-5c294d40fec4 None None] PATH_INFO: `/v3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:29.431990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 767/1516] 10.222.0.79 () {54 vars in 925 bytes} [Fri Aug 26 00:36:29 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:36:29.438921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19ef9-fbe4-4107-9757-1129ad861b4d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:29.439209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19ef9-fbe4-4107-9757-1129ad861b4d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:29.439484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae19ef9-fbe4-4107-9757-1129ad861b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:29.468916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2d9fc-00f6-4cad-8017-5c294d40fec4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:29.484271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2d9fc-00f6-4cad-8017-5c294d40fec4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:29.491212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652992b-b7b6-422e-8714-cf83e1e1fe81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:29.491823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652992b-b7b6-422e-8714-cf83e1e1fe81 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:29.492105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652992b-b7b6-422e-8714-cf83e1e1fe81 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:29.492381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652992b-b7b6-422e-8714-cf83e1e1fe81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:29.501180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652992b-b7b6-422e-8714-cf83e1e1fe81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:29.501360 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cae19ef9-fbe4-4107-9757-1129ad861b4d None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:29.502463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cae19ef9-fbe4-4107-9757-1129ad861b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:29.503155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0652992b-b7b6-422e-8714-cf83e1e1fe81 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:29.512892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 768/1517] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:36:29.564764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:36:29.587059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 750/1518] 10.222.0.79 () {58 vars in 1015 bytes} [Fri Aug 26 00:36:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:36:38.508640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f58f6e-2c20-42e1-b596-0898451d9a5e None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:38.509244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f58f6e-2c20-42e1-b596-0898451d9a5e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:38.509244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f58f6e-2c20-42e1-b596-0898451d9a5e None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:38.510504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 769/1519] 10.222.0.88 () {54 vars in 961 bytes} [Fri Aug 26 00:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:38.515537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9200f-10ab-4bab-8e6f-a5e0aed2dbdc None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:38.515982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9200f-10ab-4bab-8e6f-a5e0aed2dbdc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:38.516163 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9200f-10ab-4bab-8e6f-a5e0aed2dbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:38.537223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8cf9200f-10ab-4bab-8e6f-a5e0aed2dbdc None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:38.538495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8cf9200f-10ab-4bab-8e6f-a5e0aed2dbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:38.547357 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 751/1520] 10.222.0.88 () {58 vars in 1058 bytes} [Fri Aug 26 00:36:38 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:38.555783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f58f6e-2c20-42e1-b596-0898451d9a5e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:38.572311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f58f6e-2c20-42e1-b596-0898451d9a5e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:38.577607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6fc766-e63e-4f6e-8b01-858020e4f091 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:38.578242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fc766-e63e-4f6e-8b01-858020e4f091 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:38.578526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fc766-e63e-4f6e-8b01-858020e4f091 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:38.578801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6fc766-e63e-4f6e-8b01-858020e4f091 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:38.588391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fc766-e63e-4f6e-8b01-858020e4f091 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:38.590242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6fc766-e63e-4f6e-8b01-858020e4f091 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:38.602475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 770/1521] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:36:40.744717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1adb-da43-4d9a-b782-59b42aaa9a70 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:40.745293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1adb-da43-4d9a-b782-59b42aaa9a70 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:40.745426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cc1adb-da43-4d9a-b782-59b42aaa9a70 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:40.746699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 752/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:40.751704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debae2d-67dc-4f36-aeef-d1624e22b9b3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:40.752619 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debae2d-67dc-4f36-aeef-d1624e22b9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:40.752619 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4debae2d-67dc-4f36-aeef-d1624e22b9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:40.771853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4debae2d-67dc-4f36-aeef-d1624e22b9b3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:40.773052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4debae2d-67dc-4f36-aeef-d1624e22b9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:40.780884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 771/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:36:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:40.937642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1adb-da43-4d9a-b782-59b42aaa9a70 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:40.953386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cc1adb-da43-4d9a-b782-59b42aaa9a70 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:40.959795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd0b7b-08a5-4b64-88b7-98dfa5b4b596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:40.960394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd0b7b-08a5-4b64-88b7-98dfa5b4b596 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:40.960680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd0b7b-08a5-4b64-88b7-98dfa5b4b596 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:40.960957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd0b7b-08a5-4b64-88b7-98dfa5b4b596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:40.969154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd0b7b-08a5-4b64-88b7-98dfa5b4b596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:40.970776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd0b7b-08a5-4b64-88b7-98dfa5b4b596 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:40.980471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 753/1524] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:36:41.806937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec80be-896f-4158-9196-af9aa727864c None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:41.807503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec80be-896f-4158-9196-af9aa727864c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:41.807503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec80be-896f-4158-9196-af9aa727864c None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:41.808816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 772/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 26 00:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:41.813691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cc8a-8c4b-4679-9522-994867b83ede None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:41.814188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cc8a-8c4b-4679-9522-994867b83ede None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:41.814312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f1cc8a-8c4b-4679-9522-994867b83ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:41.834000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a8f1cc8a-8c4b-4679-9522-994867b83ede None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:41.835133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a8f1cc8a-8c4b-4679-9522-994867b83ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:41.843353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 754/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 26 00:36:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:41.997206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec80be-896f-4158-9196-af9aa727864c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:42.011909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec80be-896f-4158-9196-af9aa727864c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:42.017392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e1d2d-777a-4e59-a37c-8cc0f5bb6841 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:42.018054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1d2d-777a-4e59-a37c-8cc0f5bb6841 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:42.018336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1d2d-777a-4e59-a37c-8cc0f5bb6841 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:42.018612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e1d2d-777a-4e59-a37c-8cc0f5bb6841 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:42.027156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e1d2d-777a-4e59-a37c-8cc0f5bb6841 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:42.028745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977e1d2d-777a-4e59-a37c-8cc0f5bb6841 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:42.038769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 773/1527] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:36:46.113838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d526b7-985e-45b2-be7a-b836d23405ce None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:46.114437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d526b7-985e-45b2-be7a-b836d23405ce None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:46.114437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d526b7-985e-45b2-be7a-b836d23405ce None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:46.115804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 755/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:46.121227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e182402-30cc-4adf-99da-29c52457d5c0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:46.121664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e182402-30cc-4adf-99da-29c52457d5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:46.121768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e182402-30cc-4adf-99da-29c52457d5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:46.141080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3e182402-30cc-4adf-99da-29c52457d5c0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:46.142329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3e182402-30cc-4adf-99da-29c52457d5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:46.151196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 774/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:36:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:46.441991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d526b7-985e-45b2-be7a-b836d23405ce None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:46.443766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-22d526b7-985e-45b2-be7a-b836d23405ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:46.521636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d526b7-985e-45b2-be7a-b836d23405ce None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:46.525303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eb060b-1bc8-4844-99b4-ee68069ead30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:46.525940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb060b-1bc8-4844-99b4-ee68069ead30 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:46.526227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb060b-1bc8-4844-99b4-ee68069ead30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:46.526506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eb060b-1bc8-4844-99b4-ee68069ead30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:46.536020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb060b-1bc8-4844-99b4-ee68069ead30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:46.537446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eb060b-1bc8-4844-99b4-ee68069ead30 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:46.546961 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 756/1530] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:36:48.454784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd68952-8302-4987-855c-83ff7cbbe068 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:48.455366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd68952-8302-4987-855c-83ff7cbbe068 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:48.455366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd68952-8302-4987-855c-83ff7cbbe068 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:48.456816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 775/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:48.462085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9cfa-69ed-4791-8b07-90ee69ce4e73 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:48.462527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9cfa-69ed-4791-8b07-90ee69ce4e73 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:48.462679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9b9cfa-69ed-4791-8b07-90ee69ce4e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:48.482054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1b9b9cfa-69ed-4791-8b07-90ee69ce4e73 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:48.483267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1b9b9cfa-69ed-4791-8b07-90ee69ce4e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:48.492663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 757/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:36:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:48.794913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd68952-8302-4987-855c-83ff7cbbe068 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:48.809384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd68952-8302-4987-855c-83ff7cbbe068 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:48.813042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f974074-7971-462e-97e9-b6d2fc674e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:48.813651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974074-7971-462e-97e9-b6d2fc674e51 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:48.813970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974074-7971-462e-97e9-b6d2fc674e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:48.814247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f974074-7971-462e-97e9-b6d2fc674e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:48.823662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974074-7971-462e-97e9-b6d2fc674e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:48.825120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f974074-7971-462e-97e9-b6d2fc674e51 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:48.836318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 776/1533] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:36:52.361097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9107-f042-4302-90ad-83d17d2e4283 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:52.361644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9107-f042-4302-90ad-83d17d2e4283 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:52.361644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd9107-f042-4302-90ad-83d17d2e4283 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:52.363250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 758/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:52.368580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44a4cf-d12d-4a12-8d44-67230a813cb0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:52.369017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44a4cf-d12d-4a12-8d44-67230a813cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:52.369138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd44a4cf-d12d-4a12-8d44-67230a813cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:52.376790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:36:52.390471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bd44a4cf-d12d-4a12-8d44-67230a813cb0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:52.391680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bd44a4cf-d12d-4a12-8d44-67230a813cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:52.400341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 777/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:52.966342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9107-f042-4302-90ad-83d17d2e4283 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:52.968054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-57bd9107-f042-4302-90ad-83d17d2e4283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:53.047166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd9107-f042-4302-90ad-83d17d2e4283 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:53.051311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677f593-75e4-4cca-b70f-091d229b2c52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:53.051912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f593-75e4-4cca-b70f-091d229b2c52 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:53.052195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f593-75e4-4cca-b70f-091d229b2c52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:53.052472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677f593-75e4-4cca-b70f-091d229b2c52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:53.061310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677f593-75e4-4cca-b70f-091d229b2c52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:53.062776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677f593-75e4-4cca-b70f-091d229b2c52 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:53.072853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 759/1536] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:36:54.992170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eee76-e776-409a-bdc1-fd5fe1cfa05a None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:54.992750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eee76-e776-409a-bdc1-fd5fe1cfa05a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:54.992750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eee76-e776-409a-bdc1-fd5fe1cfa05a None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:54.994099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 778/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 26 00:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:36:54.999509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e334e5-8c51-4f0d-aa1e-85ae2f5e1012 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:54.999943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e334e5-8c51-4f0d-aa1e-85ae2f5e1012 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:55.000062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e334e5-8c51-4f0d-aa1e-85ae2f5e1012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:55.020499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e8e334e5-8c51-4f0d-aa1e-85ae2f5e1012 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:36:55.021702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e8e334e5-8c51-4f0d-aa1e-85ae2f5e1012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:55.029753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 760/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 26 00:36:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:36:55.594211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eee76-e776-409a-bdc1-fd5fe1cfa05a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:36:55.595944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-753eee76-e776-409a-bdc1-fd5fe1cfa05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:36:55.609548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eee76-e776-409a-bdc1-fd5fe1cfa05a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:36:55.613735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376d2b5-7a2f-470d-8f97-dacafae0359d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:36:55.614358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d2b5-7a2f-470d-8f97-dacafae0359d service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:36:55.614634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d2b5-7a2f-470d-8f97-dacafae0359d service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:36:55.614903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376d2b5-7a2f-470d-8f97-dacafae0359d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:36:55.623845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376d2b5-7a2f-470d-8f97-dacafae0359d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:36:55.625263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376d2b5-7a2f-470d-8f97-dacafae0359d service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:36:55.635019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 779/1539] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:37:05.015132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:37:05.630937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=8 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:25.191837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd5f4-3e9b-4c6d-8a2d-eded388eaa89 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.192490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd5f4-3e9b-4c6d-8a2d-eded388eaa89 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.192490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857dd5f4-3e9b-4c6d-8a2d-eded388eaa89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.218953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-857dd5f4-3e9b-4c6d-8a2d-eded388eaa89 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.220185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-857dd5f4-3e9b-4c6d-8a2d-eded388eaa89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.230406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 761/1540] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:25.240123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b220f1f-077a-43fe-900c-11778e064f8a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.241396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b220f1f-077a-43fe-900c-11778e064f8a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.241396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b220f1f-077a-43fe-900c-11778e064f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.263787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2b220f1f-077a-43fe-900c-11778e064f8a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.265183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2b220f1f-077a-43fe-900c-11778e064f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.275110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 780/1541] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:25.280371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dd5f4-3e9b-4c6d-8a2d-eded388eaa89 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.291063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857dd5f4-3e9b-4c6d-8a2d-eded388eaa89 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.296131 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.296744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.297024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.298061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.298720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:25.299027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.300081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:38:25.300081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 26 00:38:25.300081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: Aug 26 00:38:25.300990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.321912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 762/1542] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:25.332675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b220f1f-077a-43fe-900c-11778e064f8a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.345136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b220f1f-077a-43fe-900c-11778e064f8a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.351664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.352689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.352977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.353250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.353908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.354972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:38:25.354972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 26 00:38:25.354972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: Aug 26 00:38:25.356400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.412952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 781/1543] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:25.415604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.429533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c969a-9444-4d37-a879-c4aae07983d1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.513868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31853c2d-5d3f-491d-acdb-e5217d24e655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.514540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853c2d-5d3f-491d-acdb-e5217d24e655 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.514825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853c2d-5d3f-491d-acdb-e5217d24e655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.515100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31853c2d-5d3f-491d-acdb-e5217d24e655 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.515746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31853c2d-5d3f-491d-acdb-e5217d24e655 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.517011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-31853c2d-5d3f-491d-acdb-e5217d24e655 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:38:25.517011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 26 00:38:25.517011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: Aug 26 00:38:25.518622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31853c2d-5d3f-491d-acdb-e5217d24e655 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.549149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 763/1544] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:25.561471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.581527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df48d3-3d02-4631-ba88-d544c8a557ca None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.581823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df48d3-3d02-4631-ba88-d544c8a557ca None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.582139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df48d3-3d02-4631-ba88-d544c8a557ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.582397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2d097-89dc-420b-9525-fcf65e9a7433 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.589840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4316d7b-89d6-4199-8ae4-28c54fb269a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.590877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316d7b-89d6-4199-8ae4-28c54fb269a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.591352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316d7b-89d6-4199-8ae4-28c54fb269a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.591815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4316d7b-89d6-4199-8ae4-28c54fb269a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.592661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4316d7b-89d6-4199-8ae4-28c54fb269a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.595209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4316d7b-89d6-4199-8ae4-28c54fb269a0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.612631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 782/1545] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:25.618910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4316d7b-89d6-4199-8ae4-28c54fb269a0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.626922 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b3df48d3-3d02-4631-ba88-d544c8a557ca None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.628165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b3df48d3-3d02-4631-ba88-d544c8a557ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.633227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4316d7b-89d6-4199-8ae4-28c54fb269a0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.640086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dcf75-5947-452e-a938-fa1d01ea70c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.641396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dcf75-5947-452e-a938-fa1d01ea70c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.641898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dcf75-5947-452e-a938-fa1d01ea70c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.642354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273dcf75-5947-452e-a938-fa1d01ea70c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.643288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dcf75-5947-452e-a938-fa1d01ea70c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.644302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 764/1546] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:38:25.645318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273dcf75-5947-452e-a938-fa1d01ea70c7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.653234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ea8bb-8360-49b3-b224-48ae6e89005d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.653234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ea8bb-8360-49b3-b224-48ae6e89005d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.653521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ea8bb-8360-49b3-b224-48ae6e89005d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.661919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 783/1547] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:25.666778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dcf75-5947-452e-a938-fa1d01ea70c7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.681055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273dcf75-5947-452e-a938-fa1d01ea70c7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.687897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.689762 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.690272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.690715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] PATH_INFO: `/v3/projects/4ec000987cc740cebff2ec054610bf30/users/d23f65dcd2de40f7987e07602e75d130/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.703122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-025ea8bb-8360-49b3-b224-48ae6e89005d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.704593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-025ea8bb-8360-49b3-b224-48ae6e89005d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.715705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ec000987cc740cebff2ec054610bf30, user_id=d23f65dcd2de40f7987e07602e75d130, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.716981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:38:25.716981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 26 00:38:25.716981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: Aug 26 00:38:25.720478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.727588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 765/1548] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:25.729204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7118a3-1dbb-44f2-995f-e8b6799645df None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.729583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7118a3-1dbb-44f2-995f-e8b6799645df None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.730031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7118a3-1dbb-44f2-995f-e8b6799645df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.744019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 784/1549] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:25 2022] PUT /identity/v3/projects/4ec000987cc740cebff2ec054610bf30/users/d23f65dcd2de40f7987e07602e75d130/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:25.745227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.775046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fb7118a3-1dbb-44f2-995f-e8b6799645df None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.776401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fb7118a3-1dbb-44f2-995f-e8b6799645df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.835722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831793ab-bfeb-41a2-840a-ccb13fe50da3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.840705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a673-ec47-49ec-a719-4b97032cec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.841618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a673-ec47-49ec-a719-4b97032cec64 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.841928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a673-ec47-49ec-a719-4b97032cec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.842205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a673-ec47-49ec-a719-4b97032cec64 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.842862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959a673-ec47-49ec-a719-4b97032cec64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:25.843163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959a673-ec47-49ec-a719-4b97032cec64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.844852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959a673-ec47-49ec-a719-4b97032cec64 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.858484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 785/1550] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:25.859815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebb723-266d-45cd-8422-8f60ac55894a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.860098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebb723-266d-45cd-8422-8f60ac55894a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.860369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aebb723-266d-45cd-8422-8f60ac55894a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.869637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 766/1551] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:25.871165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d327b2-ea2b-4e43-bd81-57ea36b04d65 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.871465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d327b2-ea2b-4e43-bd81-57ea36b04d65 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.871742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d327b2-ea2b-4e43-bd81-57ea36b04d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.884904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6aebb723-266d-45cd-8422-8f60ac55894a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.886356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6aebb723-266d-45cd-8422-8f60ac55894a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.898609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 786/1552] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:25.898609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ec76-42b4-40ac-8004-a21ac82dc16b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.898609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ec76-42b4-40ac-8004-a21ac82dc16b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.898609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d44ec76-42b4-40ac-8004-a21ac82dc16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.914499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-20d327b2-ea2b-4e43-bd81-57ea36b04d65 None None] MFA Rules not processed for user `d23f65dcd2de40f7987e07602e75d130`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.915761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-20d327b2-ea2b-4e43-bd81-57ea36b04d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.920048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5d44ec76-42b4-40ac-8004-a21ac82dc16b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.921155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5d44ec76-42b4-40ac-8004-a21ac82dc16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.932959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 787/1553] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:25.932959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7908-e8a3-41c0-8e85-c3159fd3ef12 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.932959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7908-e8a3-41c0-8e85-c3159fd3ef12 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.932959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d7908-e8a3-41c0-8e85-c3159fd3ef12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.952560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-de4d7908-e8a3-41c0-8e85-c3159fd3ef12 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:25.953772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-de4d7908-e8a3-41c0-8e85-c3159fd3ef12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:25.962045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 788/1554] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:25.962846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d7908-e8a3-41c0-8e85-c3159fd3ef12 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:25.971233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:25.972077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d7908-e8a3-41c0-8e85-c3159fd3ef12 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:25.978783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fc6f7-eeca-4596-a547-a21e5069c244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:25.979666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc6f7-eeca-4596-a547-a21e5069c244 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.979986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc6f7-eeca-4596-a547-a21e5069c244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.980364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fc6f7-eeca-4596-a547-a21e5069c244 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:25.980994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc6f7-eeca-4596-a547-a21e5069c244 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:25.983213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fc6f7-eeca-4596-a547-a21e5069c244 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:25.994611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 767/1555] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:25.995859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c44d-557f-4ce5-b68c-a984dd4ba3fd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:25.996143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c44d-557f-4ce5-b68c-a984dd4ba3fd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:25.996419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a7c44d-557f-4ce5-b68c-a984dd4ba3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.013978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 789/1556] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.018366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775bc15-8691-439a-bb3a-36b2ab30a4d4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.018662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775bc15-8691-439a-bb3a-36b2ab30a4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.018781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-20a7c44d-557f-4ce5-b68c-a984dd4ba3fd None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.018938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b775bc15-8691-439a-bb3a-36b2ab30a4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.019893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-20a7c44d-557f-4ce5-b68c-a984dd4ba3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.041055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b775bc15-8691-439a-bb3a-36b2ab30a4d4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.042365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b775bc15-8691-439a-bb3a-36b2ab30a4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.070248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:26.090768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 768/1557] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.092038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de45c0b-5f4f-4638-b9d0-17740e55b3c0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.092317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de45c0b-5f4f-4638-b9d0-17740e55b3c0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.092590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de45c0b-5f4f-4638-b9d0-17740e55b3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.108116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 790/1558] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.109450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cbb1a-3f59-4b59-8f68-72f268225dc7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.109868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cbb1a-3f59-4b59-8f68-72f268225dc7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.110184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6cbb1a-3f59-4b59-8f68-72f268225dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.112573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6de45c0b-5f4f-4638-b9d0-17740e55b3c0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.113796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6de45c0b-5f4f-4638-b9d0-17740e55b3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.122078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 769/1559] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.123323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c2cf7-6d2d-4673-8cfe-6d6ffdc319b5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.123608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c2cf7-6d2d-4673-8cfe-6d6ffdc319b5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.123984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c2cf7-6d2d-4673-8cfe-6d6ffdc319b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.132437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ed6cbb1a-3f59-4b59-8f68-72f268225dc7 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.133698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ed6cbb1a-3f59-4b59-8f68-72f268225dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.141633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 791/1560] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.142924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902099-aa38-4267-90b8-34c5f3cacaa0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.143212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902099-aa38-4267-90b8-34c5f3cacaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.143481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86902099-aa38-4267-90b8-34c5f3cacaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.149373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4a7c2cf7-6d2d-4673-8cfe-6d6ffdc319b5 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.150617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a7c2cf7-6d2d-4673-8cfe-6d6ffdc319b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.158544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 770/1561] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.159301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c2cf7-6d2d-4673-8cfe-6d6ffdc319b5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.162745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-86902099-aa38-4267-90b8-34c5f3cacaa0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.163926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-86902099-aa38-4267-90b8-34c5f3cacaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.171488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c2cf7-6d2d-4673-8cfe-6d6ffdc319b5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.172280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 792/1562] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.173299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357a51c-d5fb-4084-ab4f-c71923a08825 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.173581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357a51c-d5fb-4084-ab4f-c71923a08825 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.173857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357a51c-d5fb-4084-ab4f-c71923a08825 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.175906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 793/1563] 10.222.0.88 () {54 vars in 962 bytes} [Fri Aug 26 00:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:26.176407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe39a2-044c-432b-bf77-9f0d5c28fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.176910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357a51c-d5fb-4084-ab4f-c71923a08825 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.177027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe39a2-044c-432b-bf77-9f0d5c28fc9f admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.177259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe39a2-044c-432b-bf77-9f0d5c28fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.177536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe39a2-044c-432b-bf77-9f0d5c28fc9f admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.178233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe39a2-044c-432b-bf77-9f0d5c28fc9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.180355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe39a2-044c-432b-bf77-9f0d5c28fc9f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.189697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357a51c-d5fb-4084-ab4f-c71923a08825 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.195005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.195638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.195905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.196242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.196864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:26.197216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.198901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.202582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 771/1564] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.203717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2031d5a-e07f-4762-806b-3d101a087e38 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.204006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2031d5a-e07f-4762-806b-3d101a087e38 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.204282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2031d5a-e07f-4762-806b-3d101a087e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.211185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 794/1565] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:26.211996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.221489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a19eb9-5529-4212-8183-312de177ea07 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.225715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d2031d5a-e07f-4762-806b-3d101a087e38 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.226082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835387d-2aeb-4afa-b3d2-74e3b7b81e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.226672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835387d-2aeb-4afa-b3d2-74e3b7b81e71 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.226955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835387d-2aeb-4afa-b3d2-74e3b7b81e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.227054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d2031d5a-e07f-4762-806b-3d101a087e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.227232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835387d-2aeb-4afa-b3d2-74e3b7b81e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.227866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835387d-2aeb-4afa-b3d2-74e3b7b81e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:26.228170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835387d-2aeb-4afa-b3d2-74e3b7b81e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.229758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835387d-2aeb-4afa-b3d2-74e3b7b81e71 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.234883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 772/1566] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.235726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2031d5a-e07f-4762-806b-3d101a087e38 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.242827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 795/1567] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:26.250632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2031d5a-e07f-4762-806b-3d101a087e38 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.250749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bdbe1-9899-4411-a7c8-8f76b64ade94 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.250749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bdbe1-9899-4411-a7c8-8f76b64ade94 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.250749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22bdbe1-9899-4411-a7c8-8f76b64ade94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.253218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.253839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.254154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.254427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.255073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:26.255374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.257519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.268470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e22bdbe1-9899-4411-a7c8-8f76b64ade94 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.276606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 773/1568] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:26.276778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e22bdbe1-9899-4411-a7c8-8f76b64ade94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.276906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.278615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 796/1569] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.279895 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a349-233c-4e04-b4d2-c8705d168e54 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.280176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a349-233c-4e04-b4d2-c8705d168e54 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.280451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233a349-233c-4e04-b4d2-c8705d168e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.280890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbbd71-a17c-41c9-a95a-e722e4699598 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.285505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.286126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.286411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.286688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.287613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:26.287885 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.289471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.301723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 774/1570] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:26.302560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.312234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2e9024-163e-40be-863e-e8deda49614b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.317016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fd7f3-2286-4073-b655-72d95824048c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.317604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd7f3-2286-4073-b655-72d95824048c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.317911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd7f3-2286-4073-b655-72d95824048c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.318198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fd7f3-2286-4073-b655-72d95824048c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.319423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fd7f3-2286-4073-b655-72d95824048c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.320139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d233a349-233c-4e04-b4d2-c8705d168e54 None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:26.321035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fd7f3-2286-4073-b655-72d95824048c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.321347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d233a349-233c-4e04-b4d2-c8705d168e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:26.331051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 775/1571] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:26.331823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fd7f3-2286-4073-b655-72d95824048c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.343740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fd7f3-2286-4073-b655-72d95824048c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.348562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a81cc-d04c-4fd8-8e96-7449c3550658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.348786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a81cc-d04c-4fd8-8e96-7449c3550658 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.349064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a81cc-d04c-4fd8-8e96-7449c3550658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.349365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7a81cc-d04c-4fd8-8e96-7449c3550658 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.350250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a81cc-d04c-4fd8-8e96-7449c3550658 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.352201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7a81cc-d04c-4fd8-8e96-7449c3550658 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.379463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 776/1572] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.380274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a81cc-d04c-4fd8-8e96-7449c3550658 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.392990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 797/1573] 10.222.0.88 () {58 vars in 1059 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:26.394851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233a349-233c-4e04-b4d2-c8705d168e54 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.405387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233a349-233c-4e04-b4d2-c8705d168e54 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.432972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:26.445532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7a81cc-d04c-4fd8-8e96-7449c3550658 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.451172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.451870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.452063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.452340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.452990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:26.453295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.455666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.467156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 777/1574] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:26.470446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f76e97-41ed-4b03-bd18-f70e0bd80630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.471134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76e97-41ed-4b03-bd18-f70e0bd80630 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.471427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76e97-41ed-4b03-bd18-f70e0bd80630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.471703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f76e97-41ed-4b03-bd18-f70e0bd80630 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.471947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.472348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f76e97-41ed-4b03-bd18-f70e0bd80630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.475207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f76e97-41ed-4b03-bd18-f70e0bd80630 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.481395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:26.484532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6937b6-30e4-4009-b287-150f50d1c916 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.489273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddceb9-7a96-4b97-b248-e5c69637bfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.489895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddceb9-7a96-4b97-b248-e5c69637bfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.490232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddceb9-7a96-4b97-b248-e5c69637bfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.491083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ddceb9-7a96-4b97-b248-e5c69637bfb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.491831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddceb9-7a96-4b97-b248-e5c69637bfb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.493734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ddceb9-7a96-4b97-b248-e5c69637bfb0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.504683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 798/1575] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.505584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f76e97-41ed-4b03-bd18-f70e0bd80630 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.524731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 778/1576] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.524731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddceb9-7a96-4b97-b248-e5c69637bfb0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.572080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f76e97-41ed-4b03-bd18-f70e0bd80630 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.591968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ddceb9-7a96-4b97-b248-e5c69637bfb0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.596461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418ed29-5cd8-4ac6-8ae0-b092b31f6922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.597063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ed29-5cd8-4ac6-8ae0-b092b31f6922 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.597344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ed29-5cd8-4ac6-8ae0-b092b31f6922 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.597616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e418ed29-5cd8-4ac6-8ae0-b092b31f6922 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.598267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418ed29-5cd8-4ac6-8ae0-b092b31f6922 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.600328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e418ed29-5cd8-4ac6-8ae0-b092b31f6922 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.627644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 779/1577] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.628703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418ed29-5cd8-4ac6-8ae0-b092b31f6922 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.629854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.630496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.631366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.631366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.631950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:26.632257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.633863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.645470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 799/1578] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:26.646292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.664993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb4263-8d05-42f3-8756-fed4e9f5712f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.698613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e418ed29-5cd8-4ac6-8ae0-b092b31f6922 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.703394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8be48-6ae0-4263-9a10-f427ae5edc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.704005 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8be48-6ae0-4263-9a10-f427ae5edc9f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.704290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8be48-6ae0-4263-9a10-f427ae5edc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.704566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc8be48-6ae0-4263-9a10-f427ae5edc9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.705385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8be48-6ae0-4263-9a10-f427ae5edc9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.707054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc8be48-6ae0-4263-9a10-f427ae5edc9f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.717087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 780/1579] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:26.721021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8be48-6ae0-4263-9a10-f427ae5edc9f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.728203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a572-e61d-486c-bce0-818c3596ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.728892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a572-e61d-486c-bce0-818c3596ca75 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.729253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a572-e61d-486c-bce0-818c3596ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.729605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be0a572-e61d-486c-bce0-818c3596ca75 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.730453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0a572-e61d-486c-bce0-818c3596ca75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.732464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be0a572-e61d-486c-bce0-818c3596ca75 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.754656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 800/1580] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/users => generated 284 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.755548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a572-e61d-486c-bce0-818c3596ca75 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.765469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be0a572-e61d-486c-bce0-818c3596ca75 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.769477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:26.770143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9cf82-1a37-42b6-b4af-6542a9df1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.770749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9cf82-1a37-42b6-b4af-6542a9df1c26 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.771020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9cf82-1a37-42b6-b4af-6542a9df1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.771300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9cf82-1a37-42b6-b4af-6542a9df1c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.772158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9cf82-1a37-42b6-b4af-6542a9df1c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.774247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a9cf82-1a37-42b6-b4af-6542a9df1c26 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.790608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:26.798689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc8be48-6ae0-4263-9a10-f427ae5edc9f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.804171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 801/1581] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.805022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9cf82-1a37-42b6-b4af-6542a9df1c26 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.805158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c31dd-50f0-47f8-9fc6-c7424620c8ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.805651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c31dd-50f0-47f8-9fc6-c7424620c8ae service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.806068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c31dd-50f0-47f8-9fc6-c7424620c8ae service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.806352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c31dd-50f0-47f8-9fc6-c7424620c8ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.864537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c31dd-50f0-47f8-9fc6-c7424620c8ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.867024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c31dd-50f0-47f8-9fc6-c7424620c8ae service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.870446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9cf82-1a37-42b6-b4af-6542a9df1c26 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.875269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b2f44-1af4-4264-81f1-be3424f7a494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.875880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2f44-1af4-4264-81f1-be3424f7a494 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.876174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2f44-1af4-4264-81f1-be3424f7a494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.876450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b2f44-1af4-4264-81f1-be3424f7a494 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.876564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 781/1582] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:26.877161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b2f44-1af4-4264-81f1-be3424f7a494 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.877285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c31dd-50f0-47f8-9fc6-c7424620c8ae service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.879203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8b2f44-1af4-4264-81f1-be3424f7a494 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.887284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c31dd-50f0-47f8-9fc6-c7424620c8ae service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.892722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4285d0-8661-4088-948e-9a81d80e8134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.893780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4285d0-8661-4088-948e-9a81d80e8134 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.894216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4285d0-8661-4088-948e-9a81d80e8134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.894432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4285d0-8661-4088-948e-9a81d80e8134 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.895178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4285d0-8661-4088-948e-9a81d80e8134 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.897616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4285d0-8661-4088-948e-9a81d80e8134 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.907411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 802/1583] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.908092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b2f44-1af4-4264-81f1-be3424f7a494 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.921398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8b2f44-1af4-4264-81f1-be3424f7a494 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.922702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 782/1584] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.923700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4285d0-8661-4088-948e-9a81d80e8134 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.929948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec138e-e8e6-48d6-a60b-8e854011ce60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.930747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec138e-e8e6-48d6-a60b-8e854011ce60 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.931139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec138e-e8e6-48d6-a60b-8e854011ce60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.931484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ec138e-e8e6-48d6-a60b-8e854011ce60 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.932215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec138e-e8e6-48d6-a60b-8e854011ce60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.934407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ec138e-e8e6-48d6-a60b-8e854011ce60 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.936178 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4285d0-8661-4088-948e-9a81d80e8134 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.941608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26781-d423-40d0-b9f8-9b3b852cc418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.942538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26781-d423-40d0-b9f8-9b3b852cc418 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.942901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26781-d423-40d0-b9f8-9b3b852cc418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.943466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf26781-d423-40d0-b9f8-9b3b852cc418 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.944564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf26781-d423-40d0-b9f8-9b3b852cc418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:26.948006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf26781-d423-40d0-b9f8-9b3b852cc418 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:26.961986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 803/1585] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/users => generated 294 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.961986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec138e-e8e6-48d6-a60b-8e854011ce60 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.970693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ec138e-e8e6-48d6-a60b-8e854011ce60 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:26.977229 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb13b-a5d2-4c0b-b5a6-3aff58688726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:26.978318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb13b-a5d2-4c0b-b5a6-3aff58688726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:26.978782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb13b-a5d2-4c0b-b5a6-3aff58688726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:26.979249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fb13b-a5d2-4c0b-b5a6-3aff58688726 admin admin] PATH_INFO: `/v3/projects/7e749ca7c41548ffafe6adf83955a395/users/36644d90057e4dd78064bd0a11627275/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:26.981911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 783/1586] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:26 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:26.987578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26781-d423-40d0-b9f8-9b3b852cc418 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:26.997489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fb13b-a5d2-4c0b-b5a6-3aff58688726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e749ca7c41548ffafe6adf83955a395, user_id=36644d90057e4dd78064bd0a11627275, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.000390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fb13b-a5d2-4c0b-b5a6-3aff58688726 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.020278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 804/1587] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:26 2022] PUT /identity/v3/projects/7e749ca7c41548ffafe6adf83955a395/users/36644d90057e4dd78064bd0a11627275/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:27.020278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb13b-a5d2-4c0b-b5a6-3aff58688726 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.064486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf26781-d423-40d0-b9f8-9b3b852cc418 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.095321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fb13b-a5d2-4c0b-b5a6-3aff58688726 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.101323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86156-3201-4522-b82a-270a2ec47b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.101981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86156-3201-4522-b82a-270a2ec47b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.102271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86156-3201-4522-b82a-270a2ec47b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.102553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d86156-3201-4522-b82a-270a2ec47b16 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.103185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d86156-3201-4522-b82a-270a2ec47b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.105143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d86156-3201-4522-b82a-270a2ec47b16 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.114959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:27.128102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 805/1588] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:27 2022] POST /identity/v3/users => generated 286 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:27.129318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86156-3201-4522-b82a-270a2ec47b16 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.129442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f9593-b68e-468a-8c98-24d94735fbf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.130080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9593-b68e-468a-8c98-24d94735fbf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.130369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9593-b68e-468a-8c98-24d94735fbf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.130640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6f9593-b68e-468a-8c98-24d94735fbf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.131448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f9593-b68e-468a-8c98-24d94735fbf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.133034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6f9593-b68e-468a-8c98-24d94735fbf5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.139692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d86156-3201-4522-b82a-270a2ec47b16 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.143588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 784/1589] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:26 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.144402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f9593-b68e-468a-8c98-24d94735fbf5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.148254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea75d9-612f-48f3-906f-b9751b1df6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.148888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea75d9-612f-48f3-906f-b9751b1df6b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.149177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea75d9-612f-48f3-906f-b9751b1df6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.149454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ea75d9-612f-48f3-906f-b9751b1df6b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.150129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea75d9-612f-48f3-906f-b9751b1df6b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.151761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ea75d9-612f-48f3-906f-b9751b1df6b1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.155428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6f9593-b68e-468a-8c98-24d94735fbf5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.160375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f5d4f-820e-498f-83fe-4b233d8bfcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.160963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f5d4f-820e-498f-83fe-4b233d8bfcee admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.161251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f5d4f-820e-498f-83fe-4b233d8bfcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.161526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f5d4f-820e-498f-83fe-4b233d8bfcee admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.162245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f5d4f-820e-498f-83fe-4b233d8bfcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.166267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 806/1590] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.166267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea75d9-612f-48f3-906f-b9751b1df6b1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.166501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9f5d4f-820e-498f-83fe-4b233d8bfcee admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.174387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ea75d9-612f-48f3-906f-b9751b1df6b1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.175753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 785/1591] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.179042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f5d4f-820e-498f-83fe-4b233d8bfcee admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.179253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9c89e2-29be-43f2-89f3-f6786c703970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.179792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c89e2-29be-43f2-89f3-f6786c703970 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.180082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c89e2-29be-43f2-89f3-f6786c703970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.180359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9c89e2-29be-43f2-89f3-f6786c703970 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.180995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c89e2-29be-43f2-89f3-f6786c703970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.182622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9c89e2-29be-43f2-89f3-f6786c703970 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.189141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f5d4f-820e-498f-83fe-4b233d8bfcee admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.196683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 807/1592] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.196831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdaf52-c826-4c40-9ce9-c96cef264b92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.196831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdaf52-c826-4c40-9ce9-c96cef264b92 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.196831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdaf52-c826-4c40-9ce9-c96cef264b92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.197117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af086-efb4-43c7-94cf-7000e384e335 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.197208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdaf52-c826-4c40-9ce9-c96cef264b92 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.197305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af086-efb4-43c7-94cf-7000e384e335 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.197305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62af086-efb4-43c7-94cf-7000e384e335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.197492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdaf52-c826-4c40-9ce9-c96cef264b92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.198414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdaf52-c826-4c40-9ce9-c96cef264b92 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.217534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e62af086-efb4-43c7-94cf-7000e384e335 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:27.218791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e62af086-efb4-43c7-94cf-7000e384e335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:27.221597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 786/1593] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:27 2022] POST /identity/v3/users => generated 297 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:27.222970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3f58-6768-4659-9c1e-ecfe43a48432 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.223263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3f58-6768-4659-9c1e-ecfe43a48432 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.223539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b3f58-6768-4659-9c1e-ecfe43a48432 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.225803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 787/1594] 10.222.0.88 () {54 vars in 912 bytes} [Fri Aug 26 00:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:27.226328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3f58-6768-4659-9c1e-ecfe43a48432 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.228670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 808/1595] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:27.229634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62af086-efb4-43c7-94cf-7000e384e335 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.236596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:27.241319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62af086-efb4-43c7-94cf-7000e384e335 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.245322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b3f58-6768-4659-9c1e-ecfe43a48432 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.247857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd597a3-93f9-45ac-9041-2ee8495a8da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.248465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd597a3-93f9-45ac-9041-2ee8495a8da3 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.248745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd597a3-93f9-45ac-9041-2ee8495a8da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.249013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd597a3-93f9-45ac-9041-2ee8495a8da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.249656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd597a3-93f9-45ac-9041-2ee8495a8da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.250345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3013-ae11-4ef8-b2db-8d9e7abea7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.251020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3013-ae11-4ef8-b2db-8d9e7abea7aa admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.251304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3013-ae11-4ef8-b2db-8d9e7abea7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.251424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd597a3-93f9-45ac-9041-2ee8495a8da3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.251894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f3013-ae11-4ef8-b2db-8d9e7abea7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.252214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3013-ae11-4ef8-b2db-8d9e7abea7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.253794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f3013-ae11-4ef8-b2db-8d9e7abea7aa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.262598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 809/1596] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.267561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 788/1597] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.267694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd597a3-93f9-45ac-9041-2ee8495a8da3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.267806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3013-ae11-4ef8-b2db-8d9e7abea7aa admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.276248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd597a3-93f9-45ac-9041-2ee8495a8da3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.276794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f3013-ae11-4ef8-b2db-8d9e7abea7aa admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.280780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cefde9-9835-467a-9e9d-cfbdd5e188ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.281365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cefde9-9835-467a-9e9d-cfbdd5e188ed admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.281644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cefde9-9835-467a-9e9d-cfbdd5e188ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.281763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0f471-4534-402e-9f57-ba265e7aa3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.281945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cefde9-9835-467a-9e9d-cfbdd5e188ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.282326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f471-4534-402e-9f57-ba265e7aa3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.282581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cefde9-9835-467a-9e9d-cfbdd5e188ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.282695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f471-4534-402e-9f57-ba265e7aa3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.282950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0f471-4534-402e-9f57-ba265e7aa3c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.283646 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0f471-4534-402e-9f57-ba265e7aa3c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.284156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cefde9-9835-467a-9e9d-cfbdd5e188ed admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.285310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0f471-4534-402e-9f57-ba265e7aa3c9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.294092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 810/1598] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.295137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cefde9-9835-467a-9e9d-cfbdd5e188ed admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.298676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 789/1599] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.298676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0f471-4534-402e-9f57-ba265e7aa3c9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.306625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0f471-4534-402e-9f57-ba265e7aa3c9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.307407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cefde9-9835-467a-9e9d-cfbdd5e188ed admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.311156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4beb0d-5d49-4b27-bc35-d47a22f4c710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.311731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4beb0d-5d49-4b27-bc35-d47a22f4c710 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.311868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf18cd-b71f-4113-8a0e-d20d34137bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.312013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4beb0d-5d49-4b27-bc35-d47a22f4c710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.312286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4beb0d-5d49-4b27-bc35-d47a22f4c710 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.312398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf18cd-b71f-4113-8a0e-d20d34137bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.312676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf18cd-b71f-4113-8a0e-d20d34137bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.312914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4beb0d-5d49-4b27-bc35-d47a22f4c710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.313021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf18cd-b71f-4113-8a0e-d20d34137bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.313560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf18cd-b71f-4113-8a0e-d20d34137bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.314551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4beb0d-5d49-4b27-bc35-d47a22f4c710 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.315156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf18cd-b71f-4113-8a0e-d20d34137bb3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.326033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 811/1600] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.326198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 790/1601] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.326959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4beb0d-5d49-4b27-bc35-d47a22f4c710 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.328258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cad0d-f215-4336-b33b-4333d6531315 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.328646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cad0d-f215-4336-b33b-4333d6531315 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.329214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566cad0d-f215-4336-b33b-4333d6531315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.349457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-566cad0d-f215-4336-b33b-4333d6531315 None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:27.351518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-566cad0d-f215-4336-b33b-4333d6531315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:27.384979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4beb0d-5d49-4b27-bc35-d47a22f4c710 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.388750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783378a-8b64-4152-8c1a-c8b71b7cfd68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.389358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783378a-8b64-4152-8c1a-c8b71b7cfd68 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.389645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783378a-8b64-4152-8c1a-c8b71b7cfd68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.389952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783378a-8b64-4152-8c1a-c8b71b7cfd68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.399826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783378a-8b64-4152-8c1a-c8b71b7cfd68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.401328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783378a-8b64-4152-8c1a-c8b71b7cfd68 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.411219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 791/1602] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:27.412059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783378a-8b64-4152-8c1a-c8b71b7cfd68 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.421282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 812/1603] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:38:27 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:27.422003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cad0d-f215-4336-b33b-4333d6531315 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.422751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783378a-8b64-4152-8c1a-c8b71b7cfd68 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.427501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c2c07-4c7a-4339-80d3-f586f031f0b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.428369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c2c07-4c7a-4339-80d3-f586f031f0b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.428665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c2c07-4c7a-4339-80d3-f586f031f0b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.428944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c2c07-4c7a-4339-80d3-f586f031f0b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.429755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c2c07-4c7a-4339-80d3-f586f031f0b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.433527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566cad0d-f215-4336-b33b-4333d6531315 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.435082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c2c07-4c7a-4339-80d3-f586f031f0b5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.440480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed7bb-d032-44c8-aa5c-a8cfbe4bb5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.441356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed7bb-d032-44c8-aa5c-a8cfbe4bb5f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.442000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed7bb-d032-44c8-aa5c-a8cfbe4bb5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.442137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aed7bb-d032-44c8-aa5c-a8cfbe4bb5f0 admin admin] PATH_INFO: `/v3/projects/594e163f66a44710a2346ed2237e53a8/users/e4301d63bd1e44b1aaea8138c5ffe306/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.447561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 792/1604] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.448336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c2c07-4c7a-4339-80d3-f586f031f0b5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.460171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c2c07-4c7a-4339-80d3-f586f031f0b5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.463888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aed7bb-d032-44c8-aa5c-a8cfbe4bb5f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=594e163f66a44710a2346ed2237e53a8, user_id=e4301d63bd1e44b1aaea8138c5ffe306, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.464904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbde9f-2fc7-4f45-bdd5-5f6a02adfa6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.465736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbde9f-2fc7-4f45-bdd5-5f6a02adfa6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.466059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbde9f-2fc7-4f45-bdd5-5f6a02adfa6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.466334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbde9f-2fc7-4f45-bdd5-5f6a02adfa6f admin admin] PATH_INFO: `/v3/projects/787fb3699a2f496b8277193250a79f97/users/266a34590c4645ffa4c1c4afe3a9970d/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.466952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aed7bb-d032-44c8-aa5c-a8cfbe4bb5f0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.482731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbde9f-2fc7-4f45-bdd5-5f6a02adfa6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=787fb3699a2f496b8277193250a79f97, user_id=266a34590c4645ffa4c1c4afe3a9970d, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.494906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 813/1605] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:27 2022] PUT /identity/v3/projects/594e163f66a44710a2346ed2237e53a8/users/e4301d63bd1e44b1aaea8138c5ffe306/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:27.494906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed7bb-d032-44c8-aa5c-a8cfbe4bb5f0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.495208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbde9f-2fc7-4f45-bdd5-5f6a02adfa6f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.507369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 793/1606] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:27 2022] PUT /identity/v3/projects/787fb3699a2f496b8277193250a79f97/users/266a34590c4645ffa4c1c4afe3a9970d/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:27.508536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbde9f-2fc7-4f45-bdd5-5f6a02adfa6f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.565180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aed7bb-d032-44c8-aa5c-a8cfbe4bb5f0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.571887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:27.587894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbde9f-2fc7-4f45-bdd5-5f6a02adfa6f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.593626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5269-4348-4889-bb68-8678c628cb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.594334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5269-4348-4889-bb68-8678c628cb34 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.594688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5269-4348-4889-bb68-8678c628cb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.595276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eae5269-4348-4889-bb68-8678c628cb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.596345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae5269-4348-4889-bb68-8678c628cb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.597731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eae5269-4348-4889-bb68-8678c628cb34 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.611978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 794/1607] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:27.612640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5269-4348-4889-bb68-8678c628cb34 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.630068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:27.636192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eae5269-4348-4889-bb68-8678c628cb34 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.642038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c524867-d9f4-4e0c-afbe-cde404548e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.642705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c524867-d9f4-4e0c-afbe-cde404548e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.642989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c524867-d9f4-4e0c-afbe-cde404548e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.643265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c524867-d9f4-4e0c-afbe-cde404548e61 admin admin] PATH_INFO: `/v3/projects/90092870bdf44a6f874ab7827637d274/users/609226ba12414bd0aecb6605a2bc66dd/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.649240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf9d6-96cb-42ff-8bf9-7eafa74dcbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.650094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf9d6-96cb-42ff-8bf9-7eafa74dcbcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.650384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf9d6-96cb-42ff-8bf9-7eafa74dcbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.650704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3caf9d6-96cb-42ff-8bf9-7eafa74dcbcb admin admin] PATH_INFO: `/v3/projects/b3a4b47e6ffc49ea8b209c09d56dfc6f/users/1e414e82d0f34c8083cd95f6c79d27f8/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.661927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c524867-d9f4-4e0c-afbe-cde404548e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90092870bdf44a6f874ab7827637d274, user_id=609226ba12414bd0aecb6605a2bc66dd, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.665582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c524867-d9f4-4e0c-afbe-cde404548e61 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.675322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caf9d6-96cb-42ff-8bf9-7eafa74dcbcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3a4b47e6ffc49ea8b209c09d56dfc6f, user_id=1e414e82d0f34c8083cd95f6c79d27f8, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.678079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3caf9d6-96cb-42ff-8bf9-7eafa74dcbcb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.684149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 795/1608] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:27 2022] PUT /identity/v3/projects/90092870bdf44a6f874ab7827637d274/users/609226ba12414bd0aecb6605a2bc66dd/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:27.685426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c524867-d9f4-4e0c-afbe-cde404548e61 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.706018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 814/1609] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:27 2022] PUT /identity/v3/projects/b3a4b47e6ffc49ea8b209c09d56dfc6f/users/1e414e82d0f34c8083cd95f6c79d27f8/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:27.706018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf9d6-96cb-42ff-8bf9-7eafa74dcbcb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:27.752876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c524867-d9f4-4e0c-afbe-cde404548e61 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.806252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3caf9d6-96cb-42ff-8bf9-7eafa74dcbcb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:27.811296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0cc82a-172f-4c06-89fb-6363e76562f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.812030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cc82a-172f-4c06-89fb-6363e76562f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.812313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cc82a-172f-4c06-89fb-6363e76562f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.812588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0cc82a-172f-4c06-89fb-6363e76562f0 admin admin] PATH_INFO: `/v3/projects/20797b0484b34788bebaa4c1023602ce/users/eba23291e5284324b6c03fd51f2e8388/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.816134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8351876e-f1b4-48f7-b9cd-442796883a84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:27.816748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351876e-f1b4-48f7-b9cd-442796883a84 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.817184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351876e-f1b4-48f7-b9cd-442796883a84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.817457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8351876e-f1b4-48f7-b9cd-442796883a84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.840982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cc82a-172f-4c06-89fb-6363e76562f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20797b0484b34788bebaa4c1023602ce, user_id=eba23291e5284324b6c03fd51f2e8388, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.844148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0cc82a-172f-4c06-89fb-6363e76562f0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.862029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 815/1610] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:27 2022] PUT /identity/v3/projects/20797b0484b34788bebaa4c1023602ce/users/eba23291e5284324b6c03fd51f2e8388/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:27.863842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4152d1-0a47-4587-86c4-5a3eea41f3df None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.864883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4152d1-0a47-4587-86c4-5a3eea41f3df None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.865928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4152d1-0a47-4587-86c4-5a3eea41f3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.900091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351876e-f1b4-48f7-b9cd-442796883a84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:27.900455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8d4152d1-0a47-4587-86c4-5a3eea41f3df None None] MFA Rules not processed for user `e4301d63bd1e44b1aaea8138c5ffe306`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:27.901722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8d4152d1-0a47-4587-86c4-5a3eea41f3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:27.902418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8351876e-f1b4-48f7-b9cd-442796883a84 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:27.914512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 796/1611] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:27.918734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9db94-f42f-4129-9c45-6964e3ffbc4f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:27.919187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9db94-f42f-4129-9c45-6964e3ffbc4f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:27.919894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c9db94-f42f-4129-9c45-6964e3ffbc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:27.945296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-18c9db94-f42f-4129-9c45-6964e3ffbc4f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:27.946887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-18c9db94-f42f-4129-9c45-6964e3ffbc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:27.969266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:27.986633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 816/1612] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:27.987820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4152d1-0a47-4587-86c4-5a3eea41f3df None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.050348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 797/1613] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:28.052191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630067c5-2059-4618-b934-237d2be55f7a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.052672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630067c5-2059-4618-b934-237d2be55f7a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.053793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630067c5-2059-4618-b934-237d2be55f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.061787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:28.086984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4152d1-0a47-4587-86c4-5a3eea41f3df None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.092773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb69668-d282-4f0e-ad7b-976e7cc9d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.092947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-630067c5-2059-4618-b934-237d2be55f7a None None] MFA Rules not processed for user `609226ba12414bd0aecb6605a2bc66dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:28.093454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69668-d282-4f0e-ad7b-976e7cc9d82d admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.093738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69668-d282-4f0e-ad7b-976e7cc9d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.094068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb69668-d282-4f0e-ad7b-976e7cc9d82d admin admin] PATH_INFO: `/v3/projects/929e35361952471c9e177f5d991f25d8/users/db949ab99ca14a788b2815e3ba59440c/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.095056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-630067c5-2059-4618-b934-237d2be55f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.111408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb69668-d282-4f0e-ad7b-976e7cc9d82d admin admin] RBAC: Authorizing `identity:create_grant(project_id=929e35361952471c9e177f5d991f25d8, user_id=db949ab99ca14a788b2815e3ba59440c, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:28.116117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb69668-d282-4f0e-ad7b-976e7cc9d82d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:28.139174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 817/1614] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:27 2022] PUT /identity/v3/projects/929e35361952471c9e177f5d991f25d8/users/db949ab99ca14a788b2815e3ba59440c/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:28.140831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721a74b-105b-41f0-b64d-27f2cea8582d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.141172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721a74b-105b-41f0-b64d-27f2cea8582d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.141459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721a74b-105b-41f0-b64d-27f2cea8582d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.185686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9721a74b-105b-41f0-b64d-27f2cea8582d None None] MFA Rules not processed for user `1e414e82d0f34c8083cd95f6c79d27f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:28.186984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9721a74b-105b-41f0-b64d-27f2cea8582d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.236727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 798/1615] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:28.238405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea2f1b-a443-48ef-9419-098201db2c9d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.241202 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea2f1b-a443-48ef-9419-098201db2c9d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.241602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea2f1b-a443-48ef-9419-098201db2c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.271965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 818/1616] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:28.273367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721a74b-105b-41f0-b64d-27f2cea8582d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.281494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8dea2f1b-a443-48ef-9419-098201db2c9d None None] MFA Rules not processed for user `eba23291e5284324b6c03fd51f2e8388`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:28.283278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8dea2f1b-a443-48ef-9419-098201db2c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.356311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721a74b-105b-41f0-b64d-27f2cea8582d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.367074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a892b-dca7-4673-b628-309afb807cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.367719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a892b-dca7-4673-b628-309afb807cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.368090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a892b-dca7-4673-b628-309afb807cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.368381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a892b-dca7-4673-b628-309afb807cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.378941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 799/1617] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:28.379883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea2f1b-a443-48ef-9419-098201db2c9d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.464860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:28.473953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a892b-dca7-4673-b628-309afb807cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:28.476937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a892b-dca7-4673-b628-309afb807cd7 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:28.480726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea2f1b-a443-48ef-9419-098201db2c9d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.491467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 819/1618] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:28.493048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5e040-f44a-4290-8f17-904fa19c02d6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.493492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5e040-f44a-4290-8f17-904fa19c02d6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.493779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab5e040-f44a-4290-8f17-904fa19c02d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.512089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165f76-e180-4923-b211-83df4bbe7144 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.512819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165f76-e180-4923-b211-83df4bbe7144 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.513293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165f76-e180-4923-b211-83df4bbe7144 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.513803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa165f76-e180-4923-b211-83df4bbe7144 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.530692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-aab5e040-f44a-4290-8f17-904fa19c02d6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:28.534568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-aab5e040-f44a-4290-8f17-904fa19c02d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.546729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:28.612622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa165f76-e180-4923-b211-83df4bbe7144 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:28.614491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa165f76-e180-4923-b211-83df4bbe7144 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:28.628270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 800/1619] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:28.629367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165f76-e180-4923-b211-83df4bbe7144 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.644490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa165f76-e180-4923-b211-83df4bbe7144 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.654638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d25657b-31bb-4f21-b67c-15907bcf35aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.655417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25657b-31bb-4f21-b67c-15907bcf35aa admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.655763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25657b-31bb-4f21-b67c-15907bcf35aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.656044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d25657b-31bb-4f21-b67c-15907bcf35aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.656874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25657b-31bb-4f21-b67c-15907bcf35aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:28.659249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d25657b-31bb-4f21-b67c-15907bcf35aa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:28.668560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 820/1620] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:28.670284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5e040-f44a-4290-8f17-904fa19c02d6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.690239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab5e040-f44a-4290-8f17-904fa19c02d6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.700226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df924ea-808c-4c26-9c48-87bb470fc237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.701077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df924ea-808c-4c26-9c48-87bb470fc237 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.701432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df924ea-808c-4c26-9c48-87bb470fc237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.701783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df924ea-808c-4c26-9c48-87bb470fc237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.702534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df924ea-808c-4c26-9c48-87bb470fc237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:28.704560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df924ea-808c-4c26-9c48-87bb470fc237 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:28.716989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 801/1621] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:28.718854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a568d-2c27-4fd9-9b3f-7e41f029497e None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.719142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a568d-2c27-4fd9-9b3f-7e41f029497e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.719421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a568d-2c27-4fd9-9b3f-7e41f029497e None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.726750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 802/1622] 10.222.0.88 () {54 vars in 962 bytes} [Fri Aug 26 00:38:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:28.728074 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a568d-2c27-4fd9-9b3f-7e41f029497e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.730354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-055a568d-2c27-4fd9-9b3f-7e41f029497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:28.768824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 821/1623] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/projects => generated 369 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:28.769930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df924ea-808c-4c26-9c48-87bb470fc237 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:28.855340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a568d-2c27-4fd9-9b3f-7e41f029497e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.921512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df924ea-808c-4c26-9c48-87bb470fc237 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:28.938616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8445444-38ff-4220-bfa7-a2e7c59e7a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.939279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8445444-38ff-4220-bfa7-a2e7c59e7a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.939568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8445444-38ff-4220-bfa7-a2e7c59e7a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.939849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8445444-38ff-4220-bfa7-a2e7c59e7a6f admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.940490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8445444-38ff-4220-bfa7-a2e7c59e7a6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:28.942486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8445444-38ff-4220-bfa7-a2e7c59e7a6f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:28.978724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503705e-54cf-48e9-b7d4-0c803d26c9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:28.979372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503705e-54cf-48e9-b7d4-0c803d26c9fe service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.979592 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503705e-54cf-48e9-b7d4-0c803d26c9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.979871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d503705e-54cf-48e9-b7d4-0c803d26c9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.993753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 822/1624] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/users => generated 300 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:28.995057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e089e-5fd3-4576-8cd8-37f7a7f3c89c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:28.995351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e089e-5fd3-4576-8cd8-37f7a7f3c89c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:28.995633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4e089e-5fd3-4576-8cd8-37f7a7f3c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:28.999661 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503705e-54cf-48e9-b7d4-0c803d26c9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.002120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d503705e-54cf-48e9-b7d4-0c803d26c9fe service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.017167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 803/1625] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:29.019760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503705e-54cf-48e9-b7d4-0c803d26c9fe service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.034579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d503705e-54cf-48e9-b7d4-0c803d26c9fe service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.039546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4b4e089e-5fd3-4576-8cd8-37f7a7f3c89c None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:29.040786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4b4e089e-5fd3-4576-8cd8-37f7a7f3c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:29.041588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac297772-0b9f-4ece-a4b4-f8c579fd770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.042629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297772-0b9f-4ece-a4b4-f8c579fd770b admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.043254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297772-0b9f-4ece-a4b4-f8c579fd770b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.043816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac297772-0b9f-4ece-a4b4-f8c579fd770b admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.044906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac297772-0b9f-4ece-a4b4-f8c579fd770b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.047144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac297772-0b9f-4ece-a4b4-f8c579fd770b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.079327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 804/1626] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:29 2022] POST /identity/v3/users => generated 291 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:29.080344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac297772-0b9f-4ece-a4b4-f8c579fd770b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.094191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac297772-0b9f-4ece-a4b4-f8c579fd770b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.103087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f7567-d428-401d-8e86-21ba15b9d6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.103986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7567-d428-401d-8e86-21ba15b9d6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.104495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7567-d428-401d-8e86-21ba15b9d6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.104751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f7567-d428-401d-8e86-21ba15b9d6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.105650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f7567-d428-401d-8e86-21ba15b9d6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.107331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f7567-d428-401d-8e86-21ba15b9d6f0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.109957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:29.129894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 805/1627] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:29.131741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f7567-d428-401d-8e86-21ba15b9d6f0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.144211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f7567-d428-401d-8e86-21ba15b9d6f0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.151353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574a45-2134-4491-8133-ca618495f312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.152643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574a45-2134-4491-8133-ca618495f312 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.153490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574a45-2134-4491-8133-ca618495f312 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.153856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68574a45-2134-4491-8133-ca618495f312 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.155031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68574a45-2134-4491-8133-ca618495f312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.157613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68574a45-2134-4491-8133-ca618495f312 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.172534 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 806/1628] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:29.173819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574a45-2134-4491-8133-ca618495f312 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.188235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68574a45-2134-4491-8133-ca618495f312 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.188983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 823/1629] 10.222.0.88 () {58 vars in 1059 bytes} [Fri Aug 26 00:38:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:29.190238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e089e-5fd3-4576-8cd8-37f7a7f3c89c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.194032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74115c87-4a42-46d6-9c93-08bc82c53075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.194971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115c87-4a42-46d6-9c93-08bc82c53075 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.195350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115c87-4a42-46d6-9c93-08bc82c53075 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.195777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74115c87-4a42-46d6-9c93-08bc82c53075 admin admin] PATH_INFO: `/v3/projects/0fbeb1ae7d6446229445b408b1725633/users/259ce30f31954c2799ba71fda1cae7b1/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.214539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74115c87-4a42-46d6-9c93-08bc82c53075 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbeb1ae7d6446229445b408b1725633, user_id=259ce30f31954c2799ba71fda1cae7b1, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.216215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4e089e-5fd3-4576-8cd8-37f7a7f3c89c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.218634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74115c87-4a42-46d6-9c93-08bc82c53075 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.230882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac432-a9a4-4968-9231-0e19bfb28a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.231541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac432-a9a4-4968-9231-0e19bfb28a06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.231764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac432-a9a4-4968-9231-0e19bfb28a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.232045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ac432-a9a4-4968-9231-0e19bfb28a06 admin admin] PATH_INFO: `/v3/projects/7850890308e44a6e8720de27a0670c8c/users/751eefe0727e498a84696dfd1cabe8a5/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.237071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:29.247220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 807/1630] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:29 2022] PUT /identity/v3/projects/0fbeb1ae7d6446229445b408b1725633/users/259ce30f31954c2799ba71fda1cae7b1/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:29.247220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74115c87-4a42-46d6-9c93-08bc82c53075 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.265350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ac432-a9a4-4968-9231-0e19bfb28a06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7850890308e44a6e8720de27a0670c8c, user_id=751eefe0727e498a84696dfd1cabe8a5, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.269009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ac432-a9a4-4968-9231-0e19bfb28a06 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.305107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 824/1631] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:29 2022] PUT /identity/v3/projects/7850890308e44a6e8720de27a0670c8c/users/751eefe0727e498a84696dfd1cabe8a5/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:29.305107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac432-a9a4-4968-9231-0e19bfb28a06 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.433617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74115c87-4a42-46d6-9c93-08bc82c53075 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.441581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ac432-a9a4-4968-9231-0e19bfb28a06 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.453065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c16e2-3506-414b-a057-75bc080d9ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.454486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c16e2-3506-414b-a057-75bc080d9ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.455057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c16e2-3506-414b-a057-75bc080d9ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.455641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c16e2-3506-414b-a057-75bc080d9ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.458304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c16e2-3506-414b-a057-75bc080d9ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.460922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c16e2-3506-414b-a057-75bc080d9ca8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.487309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 825/1632] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:29.502310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c16e2-3506-414b-a057-75bc080d9ca8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.515093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c16e2-3506-414b-a057-75bc080d9ca8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.521330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e8ed-3851-429a-9a60-40d233c10561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.523176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e8ed-3851-429a-9a60-40d233c10561 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.523176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e8ed-3851-429a-9a60-40d233c10561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.523422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7321e8ed-3851-429a-9a60-40d233c10561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.524339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321e8ed-3851-429a-9a60-40d233c10561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.526296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7321e8ed-3851-429a-9a60-40d233c10561 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.547460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 826/1633] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:29.548316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e8ed-3851-429a-9a60-40d233c10561 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.562334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7321e8ed-3851-429a-9a60-40d233c10561 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.568445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef537a9-d042-4db8-a869-33f9891bdf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.569336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef537a9-d042-4db8-a869-33f9891bdf07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.570635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef537a9-d042-4db8-a869-33f9891bdf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.570974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef537a9-d042-4db8-a869-33f9891bdf07 admin admin] PATH_INFO: `/v3/projects/0fbeb1ae7d6446229445b408b1725633/users/259ce30f31954c2799ba71fda1cae7b1/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.576515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef537a9-d042-4db8-a869-33f9891bdf07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fbeb1ae7d6446229445b408b1725633, user_id=259ce30f31954c2799ba71fda1cae7b1, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.580891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef537a9-d042-4db8-a869-33f9891bdf07 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.607316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79673eeb-692a-4b61-81e3-b905937650f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.608140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673eeb-692a-4b61-81e3-b905937650f0 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.608484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673eeb-692a-4b61-81e3-b905937650f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.608843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673eeb-692a-4b61-81e3-b905937650f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.610033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 827/1634] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:29 2022] PUT /identity/v3/projects/0fbeb1ae7d6446229445b408b1725633/users/259ce30f31954c2799ba71fda1cae7b1/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:29.610930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef537a9-d042-4db8-a869-33f9891bdf07 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:29.738795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79673eeb-692a-4b61-81e3-b905937650f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.741115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79673eeb-692a-4b61-81e3-b905937650f0 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.753934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:29.760581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef537a9-d042-4db8-a869-33f9891bdf07 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:29.768404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 808/1635] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:29.771778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2107424f-9e11-4c36-b5cd-08cacfcd899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:29.772455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107424f-9e11-4c36-b5cd-08cacfcd899c admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.772816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107424f-9e11-4c36-b5cd-08cacfcd899c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.773093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2107424f-9e11-4c36-b5cd-08cacfcd899c admin admin] PATH_INFO: `/v3/projects/7850890308e44a6e8720de27a0670c8c/users/751eefe0727e498a84696dfd1cabe8a5/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.774764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0addd4-2a61-45f0-a23f-044989867e23 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.775048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0addd4-2a61-45f0-a23f-044989867e23 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.775319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0addd4-2a61-45f0-a23f-044989867e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.785201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107424f-9e11-4c36-b5cd-08cacfcd899c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7850890308e44a6e8720de27a0670c8c, user_id=751eefe0727e498a84696dfd1cabe8a5, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:29.785201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2107424f-9e11-4c36-b5cd-08cacfcd899c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:29.811319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 828/1636] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:29 2022] PUT /identity/v3/projects/7850890308e44a6e8720de27a0670c8c/users/751eefe0727e498a84696dfd1cabe8a5/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:29.821750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946003eb-7dcc-49e8-8882-317368d0617b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:29.822122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946003eb-7dcc-49e8-8882-317368d0617b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:29.822313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946003eb-7dcc-49e8-8882-317368d0617b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:29.841708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1b0addd4-2a61-45f0-a23f-044989867e23 None None] MFA Rules not processed for user `259ce30f31954c2799ba71fda1cae7b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:29.845194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1b0addd4-2a61-45f0-a23f-044989867e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:29.891011 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-946003eb-7dcc-49e8-8882-317368d0617b None None] MFA Rules not processed for user `751eefe0727e498a84696dfd1cabe8a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:29.892732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-946003eb-7dcc-49e8-8882-317368d0617b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:29.992315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.023819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 809/1637] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:30.034524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0addd4-2a61-45f0-a23f-044989867e23 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.060986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 829/1638] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:29 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:30.082777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946003eb-7dcc-49e8-8882-317368d0617b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.173031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0addd4-2a61-45f0-a23f-044989867e23 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.177591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00a8b21-89d1-46ec-8b4d-603678f8fce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.178814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8b21-89d1-46ec-8b4d-603678f8fce2 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.179098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8b21-89d1-46ec-8b4d-603678f8fce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.179522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00a8b21-89d1-46ec-8b4d-603678f8fce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.205896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a8b21-89d1-46ec-8b4d-603678f8fce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.212593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00a8b21-89d1-46ec-8b4d-603678f8fce2 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.242488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 810/1639] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:38:30.246568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5ed4a-8736-4d1a-a6bc-3950d3406094 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.246568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5ed4a-8736-4d1a-a6bc-3950d3406094 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.246568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee5ed4a-8736-4d1a-a6bc-3950d3406094 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.247588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 811/1640] 10.222.0.88 () {54 vars in 912 bytes} [Fri Aug 26 00:38:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:30.257715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a0f99-dbf0-4e03-930f-036fd25e409f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.258057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a0f99-dbf0-4e03-930f-036fd25e409f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.258336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3a0f99-dbf0-4e03-930f-036fd25e409f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.259388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946003eb-7dcc-49e8-8882-317368d0617b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.263854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9109f-66be-4ed0-a86f-fd4082c91f38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.264629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9109f-66be-4ed0-a86f-fd4082c91f38 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.265046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9109f-66be-4ed0-a86f-fd4082c91f38 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.266306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9109f-66be-4ed0-a86f-fd4082c91f38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.281436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9109f-66be-4ed0-a86f-fd4082c91f38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.286611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9109f-66be-4ed0-a86f-fd4082c91f38 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.290256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1f3a0f99-dbf0-4e03-930f-036fd25e409f None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:30.291474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1f3a0f99-dbf0-4e03-930f-036fd25e409f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:30.298950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 830/1641] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:30.328531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9109f-66be-4ed0-a86f-fd4082c91f38 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.435715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 812/1642] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:38:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:30.453507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9109f-66be-4ed0-a86f-fd4082c91f38 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.461222 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.462999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.463196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.463445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] PATH_INFO: `/v3/users/609226ba12414bd0aecb6605a2bc66dd` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.465668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609226ba12414bd0aecb6605a2bc66dd)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.477003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: WARNING py.warnings [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:38:30.477003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: warnings.warn(msg) Aug 26 00:38:30.477003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: Aug 26 00:38:30.480041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a0f99-dbf0-4e03-930f-036fd25e409f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:30.484311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.491937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3a0f99-dbf0-4e03-930f-036fd25e409f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:30.499980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b53c2ae-a4dd-468a-845e-22142322908c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:30.500563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c2ae-a4dd-468a-845e-22142322908c service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.500840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c2ae-a4dd-468a-845e-22142322908c service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.501114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b53c2ae-a4dd-468a-845e-22142322908c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.516621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53c2ae-a4dd-468a-845e-22142322908c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:30.518512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b53c2ae-a4dd-468a-845e-22142322908c service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:30.535039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 813/1643] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:38:30.628825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609226ba12414bd0aecb6605a2bc66dd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:30.630618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609226ba12414bd0aecb6605a2bc66dd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:30.656495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609226ba12414bd0aecb6605a2bc66dd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:30.689032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609226ba12414bd0aecb6605a2bc66dd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:30.734465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609226ba12414bd0aecb6605a2bc66dd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:30.736526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.745161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 831/1644] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:30 2022] DELETE /identity/v3/users/609226ba12414bd0aecb6605a2bc66dd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:38:30.750837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a7d4-b20e-4534-b6e4-407b9786e358 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:30.751288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a7d4-b20e-4534-b6e4-407b9786e358 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:30.751574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a7d4-b20e-4534-b6e4-407b9786e358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:30.766655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:30.807152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0e97a7d4-b20e-4534-b6e4-407b9786e358 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:30.815213 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0e97a7d4-b20e-4534-b6e4-407b9786e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:31.003519 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:31.005420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:31.007374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 814/1645] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:31.216132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd54af-377a-4e4c-a7a2-ae8e617e4b75 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:31.220579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3939dc6-561f-4844-b7b2-b650405717ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:31.224281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3939dc6-561f-4844-b7b2-b650405717ee service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:31.224281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3939dc6-561f-4844-b7b2-b650405717ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:31.224656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3939dc6-561f-4844-b7b2-b650405717ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:31.248723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3939dc6-561f-4844-b7b2-b650405717ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:31.251430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3939dc6-561f-4844-b7b2-b650405717ee service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:31.315494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 832/1646] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:38:31.967896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a7d4-b20e-4534-b6e4-407b9786e358 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:31.971180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0e97a7d4-b20e-4534-b6e4-407b9786e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:32.026095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a7d4-b20e-4534-b6e4-407b9786e358 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:32.046304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:32.049162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:32.049735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:32.050946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] PATH_INFO: `/v3/projects/90092870bdf44a6f874ab7827637d274` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:32.057146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90092870bdf44a6f874ab7827637d274)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:32.058806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: WARNING py.warnings [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 26 00:38:32.058806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: warnings.warn(msg) Aug 26 00:38:32.058806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: Aug 26 00:38:32.062089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:32.229472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90092870bdf44a6f874ab7827637d274', 'request_id': 'req-bda86d03-bd79-40a3-9a65-88178013fad3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.262894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90092870bdf44a6f874ab7827637d274', 'request_id': 'req-bda86d03-bd79-40a3-9a65-88178013fad3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.275997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90092870bdf44a6f874ab7827637d274', 'request_id': 'req-bda86d03-bd79-40a3-9a65-88178013fad3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.307229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] The token cache is being invalidate because project 90092870bdf44a6f874ab7827637d274 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:32.308790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.310302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.319114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 815/1647] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:31 2022] DELETE /identity/v3/projects/90092870bdf44a6f874ab7827637d274 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:32.320991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3939dc6-561f-4844-b7b2-b650405717ee service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:32.352174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3939dc6-561f-4844-b7b2-b650405717ee service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:32.524959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:32.525620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:32.525926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:32.526235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] PATH_INFO: `/v3/users/259ce30f31954c2799ba71fda1cae7b1` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:32.528275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=259ce30f31954c2799ba71fda1cae7b1)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:32.530675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:32.659548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259ce30f31954c2799ba71fda1cae7b1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.662281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259ce30f31954c2799ba71fda1cae7b1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.691708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259ce30f31954c2799ba71fda1cae7b1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.711370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259ce30f31954c2799ba71fda1cae7b1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.743590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-33a48acd-125b-421b-acbf-66a4fad2bc69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259ce30f31954c2799ba71fda1cae7b1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:32.754821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 833/1648] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:32 2022] DELETE /identity/v3/users/259ce30f31954c2799ba71fda1cae7b1 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:34.011844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:34.012967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:34.050814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda86d03-bd79-40a3-9a65-88178013fad3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:34.222737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:34.223410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:34.223691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:34.224126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] PATH_INFO: `/v3/users/eba23291e5284324b6c03fd51f2e8388` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:34.226968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba23291e5284324b6c03fd51f2e8388)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:34.229172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:34.295334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:34.331641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba23291e5284324b6c03fd51f2e8388'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:34.373250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba23291e5284324b6c03fd51f2e8388'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:34.374587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba23291e5284324b6c03fd51f2e8388'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:34.400748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba23291e5284324b6c03fd51f2e8388'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:34.422823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba23291e5284324b6c03fd51f2e8388'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:34.447369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ff51-70be-4846-b2b7-7677b07a7f6b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:34.451147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ff51-70be-4846-b2b7-7677b07a7f6b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:34.451610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c154ff51-70be-4846-b2b7-7677b07a7f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:34.451734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 816/1649] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:34 2022] DELETE /identity/v3/users/eba23291e5284324b6c03fd51f2e8388 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:34.457951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:34.460271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:34.485112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c154ff51-70be-4846-b2b7-7677b07a7f6b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:34.491474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c154ff51-70be-4846-b2b7-7677b07a7f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:34.519379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:34.666953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 834/1650] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:34.698634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154ff51-70be-4846-b2b7-7677b07a7f6b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:34.700939 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c154ff51-70be-4846-b2b7-7677b07a7f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:34.741915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55de6a-0d01-4600-8adf-bd92f4497be2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:34.757277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:34.766684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:34.772430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:34.772430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] PATH_INFO: `/v3/projects/0fbeb1ae7d6446229445b408b1725633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:34.776851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fbeb1ae7d6446229445b408b1725633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:34.778893 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:34.903398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c154ff51-70be-4846-b2b7-7677b07a7f6b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:34.910377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:34.910377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:34.915187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:34.915187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:34.941668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:34.943766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:34.987729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 835/1651] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:38:34.988845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:34.994353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.036477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f0ec3f-6e0e-4154-9eb5-3cf2eb3d1fdc service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:35.043293 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fbeb1ae7d6446229445b408b1725633', 'request_id': 'req-a1a1e12c-c0e0-4a32-951e-4a2951535cec'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.061268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fbeb1ae7d6446229445b408b1725633', 'request_id': 'req-a1a1e12c-c0e0-4a32-951e-4a2951535cec'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.093592 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fbeb1ae7d6446229445b408b1725633', 'request_id': 'req-a1a1e12c-c0e0-4a32-951e-4a2951535cec'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.129285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] The token cache is being invalidate because project 0fbeb1ae7d6446229445b408b1725633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:35.132738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.135483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.139554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 817/1652] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:34 2022] DELETE /identity/v3/projects/0fbeb1ae7d6446229445b408b1725633 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:38:35.143632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:35.145523 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.200917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:35.201581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.201866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.202184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] PATH_INFO: `/v3/users/1e414e82d0f34c8083cd95f6c79d27f8` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.203365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e414e82d0f34c8083cd95f6c79d27f8)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:35.211626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:35.314278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:35.315853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e414e82d0f34c8083cd95f6c79d27f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.319475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e414e82d0f34c8083cd95f6c79d27f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.342401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e414e82d0f34c8083cd95f6c79d27f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.361135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e414e82d0f34c8083cd95f6c79d27f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.363944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:35.390563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3de8c0bd-622d-4eef-ba66-14d4d31d1d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e414e82d0f34c8083cd95f6c79d27f8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.393017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a1e12c-c0e0-4a32-951e-4a2951535cec admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:35.404582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 836/1653] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:34 2022] DELETE /identity/v3/users/1e414e82d0f34c8083cd95f6c79d27f8 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:35.405967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967fde1-1abb-476c-a23a-e78abe6c218a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.406259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967fde1-1abb-476c-a23a-e78abe6c218a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.406536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e967fde1-1abb-476c-a23a-e78abe6c218a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.414931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:35.415585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.415935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.416221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] PATH_INFO: `/v3/users/d23f65dcd2de40f7987e07602e75d130` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.423558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d23f65dcd2de40f7987e07602e75d130)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:35.427185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:35.461470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e967fde1-1abb-476c-a23a-e78abe6c218a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:35.463249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e967fde1-1abb-476c-a23a-e78abe6c218a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.594335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd23f65dcd2de40f7987e07602e75d130'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.629135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 837/1654] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:35.631238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd23f65dcd2de40f7987e07602e75d130'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.632688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13409f13-2d23-4c73-bcb4-d71c047bc9b0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.633112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13409f13-2d23-4c73-bcb4-d71c047bc9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.633580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13409f13-2d23-4c73-bcb4-d71c047bc9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.635996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd23f65dcd2de40f7987e07602e75d130'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.658111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd23f65dcd2de40f7987e07602e75d130'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.669050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3c4f7709-a769-406a-93cf-0271d27da184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd23f65dcd2de40f7987e07602e75d130'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:35.671507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-13409f13-2d23-4c73-bcb4-d71c047bc9b0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:35.674988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-13409f13-2d23-4c73-bcb4-d71c047bc9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.679683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 818/1655] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:35 2022] DELETE /identity/v3/users/d23f65dcd2de40f7987e07602e75d130 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:35.683655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94ee1-5996-4ffc-b996-be45e3f371f5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.683948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94ee1-5996-4ffc-b996-be45e3f371f5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.684528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e94ee1-5996-4ffc-b996-be45e3f371f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.699989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 838/1656] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:35.710218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f5af-a66a-408a-b009-f959c0d46ebb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.710553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f5af-a66a-408a-b009-f959c0d46ebb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.710903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25f5af-a66a-408a-b009-f959c0d46ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.721238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-40e94ee1-5996-4ffc-b996-be45e3f371f5 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:35.722560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-40e94ee1-5996-4ffc-b996-be45e3f371f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.742957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3f25f5af-a66a-408a-b009-f959c0d46ebb None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:35.744195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3f25f5af-a66a-408a-b009-f959c0d46ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.903502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 819/1657] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:35.907436 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e94ee1-5996-4ffc-b996-be45e3f371f5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:35.911239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-40e94ee1-5996-4ffc-b996-be45e3f371f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:35.915063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 839/1658] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:35.919273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f5af-a66a-408a-b009-f959c0d46ebb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:35.936553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25f5af-a66a-408a-b009-f959c0d46ebb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:35.947034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:35.947504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:35.947788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:35.948057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:35.948759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:35.949004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:35.956091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:35.980094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 840/1659] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:35.983497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:35.992515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:36.061623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e94ee1-5996-4ffc-b996-be45e3f371f5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.076556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59da67-3d83-4bdb-8a2e-f5de3b36428b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.077265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59da67-3d83-4bdb-8a2e-f5de3b36428b service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.077548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59da67-3d83-4bdb-8a2e-f5de3b36428b service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.077824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa59da67-3d83-4bdb-8a2e-f5de3b36428b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.110664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59da67-3d83-4bdb-8a2e-f5de3b36428b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:36.123480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa59da67-3d83-4bdb-8a2e-f5de3b36428b service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:36.142853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:36.150989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 820/1660] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:36.152056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59da67-3d83-4bdb-8a2e-f5de3b36428b service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.188551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa59da67-3d83-4bdb-8a2e-f5de3b36428b service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.209403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86e735-a1d0-499e-b0c4-bce30ecc3555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.210635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e735-a1d0-499e-b0c4-bce30ecc3555 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.211100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e735-a1d0-499e-b0c4-bce30ecc3555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.211548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86e735-a1d0-499e-b0c4-bce30ecc3555 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.212514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86e735-a1d0-499e-b0c4-bce30ecc3555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:36.218057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86e735-a1d0-499e-b0c4-bce30ecc3555 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:36.244773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02594526-e1d2-4ace-8607-4064639f78a5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.270082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7beb2-abf3-418d-95ee-172fc8b5d777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.270921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7beb2-abf3-418d-95ee-172fc8b5d777 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.271261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7beb2-abf3-418d-95ee-172fc8b5d777 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.273834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7beb2-abf3-418d-95ee-172fc8b5d777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.300562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 821/1661] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:36 2022] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:36.308252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7beb2-abf3-418d-95ee-172fc8b5d777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:36.309403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86e735-a1d0-499e-b0c4-bce30ecc3555 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.310688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c7beb2-abf3-418d-95ee-172fc8b5d777 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:36.330959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 841/1662] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:36.482317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86e735-a1d0-499e-b0c4-bce30ecc3555 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.492434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8218a-ab22-48b3-bae2-1f5b8c8010c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.494239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8218a-ab22-48b3-bae2-1f5b8c8010c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.494831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8218a-ab22-48b3-bae2-1f5b8c8010c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.495459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee8218a-ab22-48b3-bae2-1f5b8c8010c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.496223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8218a-ab22-48b3-bae2-1f5b8c8010c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:36.501135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee8218a-ab22-48b3-bae2-1f5b8c8010c3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:36.570969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 822/1663] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:36 2022] POST /identity/v3/users => generated 289 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:36.572582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7beb2-abf3-418d-95ee-172fc8b5d777 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.587268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c7beb2-abf3-418d-95ee-172fc8b5d777 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.611285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5ac5-a366-4fc2-a772-c636d9ae6d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.611914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5ac5-a366-4fc2-a772-c636d9ae6d11 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.612202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5ac5-a366-4fc2-a772-c636d9ae6d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.612481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6d5ac5-a366-4fc2-a772-c636d9ae6d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.613129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d5ac5-a366-4fc2-a772-c636d9ae6d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:36.614817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6d5ac5-a366-4fc2-a772-c636d9ae6d11 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:36.616399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:36.653173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 842/1664] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:36.656267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8218a-ab22-48b3-bae2-1f5b8c8010c3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.671572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee8218a-ab22-48b3-bae2-1f5b8c8010c3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.689695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34721fe1-5a46-4295-a961-b6337a3b8ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.690393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721fe1-5a46-4295-a961-b6337a3b8ada admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.690822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721fe1-5a46-4295-a961-b6337a3b8ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.691107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34721fe1-5a46-4295-a961-b6337a3b8ada admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.691787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34721fe1-5a46-4295-a961-b6337a3b8ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:36.693963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34721fe1-5a46-4295-a961-b6337a3b8ada admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:36.733350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 823/1665] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:36.735323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5ac5-a366-4fc2-a772-c636d9ae6d11 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:36.746912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6d5ac5-a366-4fc2-a772-c636d9ae6d11 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:36.752495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:36.757385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.757778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.758113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] PATH_INFO: `/v3/projects/b1b293b88bc94d56a094a8fadd69f4d3/users/73efad448c654998ab769b39210849e0/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.812149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1b293b88bc94d56a094a8fadd69f4d3, user_id=73efad448c654998ab769b39210849e0, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:36.815870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:36.853384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 843/1666] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:36 2022] PUT /identity/v3/projects/b1b293b88bc94d56a094a8fadd69f4d3/users/73efad448c654998ab769b39210849e0/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:36.854800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f636b-f7b9-459a-9f83-06ac71b7bd48 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:36.855097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f636b-f7b9-459a-9f83-06ac71b7bd48 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:36.855714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f636b-f7b9-459a-9f83-06ac71b7bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:36.920857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7d5f636b-f7b9-459a-9f83-06ac71b7bd48 None None] MFA Rules not processed for user `73efad448c654998ab769b39210849e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:36.922372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7d5f636b-f7b9-459a-9f83-06ac71b7bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:37.142579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.144551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:37.174389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 824/1667] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:38:37.180361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f636b-f7b9-459a-9f83-06ac71b7bd48 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.309010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:37.324777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0b62d-bef4-4ba2-8ba5-ae9ab5cfed91 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.337228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f636b-f7b9-459a-9f83-06ac71b7bd48 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.340743 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.341405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.341689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.342249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] PATH_INFO: `/v3/projects/20797b0484b34788bebaa4c1023602ce` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.343730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=20797b0484b34788bebaa4c1023602ce)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.345714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.352457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0300dd-d98b-4188-982c-e7312a626844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.353096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0300dd-d98b-4188-982c-e7312a626844 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.353381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0300dd-d98b-4188-982c-e7312a626844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.353656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0300dd-d98b-4188-982c-e7312a626844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.354567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0300dd-d98b-4188-982c-e7312a626844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.363388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0300dd-d98b-4188-982c-e7312a626844 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.444113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 825/1668] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:37 2022] POST /identity/v3/projects => generated 377 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:37.445818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0300dd-d98b-4188-982c-e7312a626844 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.478563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20797b0484b34788bebaa4c1023602ce', 'request_id': 'req-7a6258ae-ca56-4660-b217-ae153c3ccdfa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:37.485120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20797b0484b34788bebaa4c1023602ce', 'request_id': 'req-7a6258ae-ca56-4660-b217-ae153c3ccdfa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:37.498323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20797b0484b34788bebaa4c1023602ce', 'request_id': 'req-7a6258ae-ca56-4660-b217-ae153c3ccdfa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:37.531005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] The token cache is being invalidate because project 20797b0484b34788bebaa4c1023602ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:37.531502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:37.532333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7a6258ae-ca56-4660-b217-ae153c3ccdfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:37.534128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 844/1669] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:37 2022] DELETE /identity/v3/projects/20797b0484b34788bebaa4c1023602ce => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:37.545626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba844f-6af7-4028-ad83-4fd152c21201 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.549592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba844f-6af7-4028-ad83-4fd152c21201 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.550083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0300dd-d98b-4188-982c-e7312a626844 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.552612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba844f-6af7-4028-ad83-4fd152c21201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.602590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c9ba844f-6af7-4028-ad83-4fd152c21201 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:37.604368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c9ba844f-6af7-4028-ad83-4fd152c21201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:37.656134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.656878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.657512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.658080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.658806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.660974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.718218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 826/1670] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:37 2022] POST /identity/v3/users => generated 295 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:37.722351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.725720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:37.764978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 845/1671] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:37.776090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671512-2063-4446-add7-2cd7cf180073 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.778853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671512-2063-4446-add7-2cd7cf180073 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.779775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21671512-2063-4446-add7-2cd7cf180073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.781867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca0944-d5f6-490a-807e-f20aff33d55a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.788889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e65f5-7b30-49da-894d-dfe76d493813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.790628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e65f5-7b30-49da-894d-dfe76d493813 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.791284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e65f5-7b30-49da-894d-dfe76d493813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.791797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0e65f5-7b30-49da-894d-dfe76d493813 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.793022 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e65f5-7b30-49da-894d-dfe76d493813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.798797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0e65f5-7b30-49da-894d-dfe76d493813 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.799974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:37.817753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-21671512-2063-4446-add7-2cd7cf180073 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:37.820960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-21671512-2063-4446-add7-2cd7cf180073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:37.842655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 827/1672] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:37.846594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e65f5-7b30-49da-894d-dfe76d493813 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.849080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 846/1673] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:37.856098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21671512-2063-4446-add7-2cd7cf180073 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.869430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21671512-2063-4446-add7-2cd7cf180073 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.883652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0e65f5-7b30-49da-894d-dfe76d493813 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.898034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.898737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.898737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.898919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.899257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050fab-4c23-4d2c-86c2-1783b516a407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:37.899663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:37.899971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.900210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050fab-4c23-4d2c-86c2-1783b516a407 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:37.900613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050fab-4c23-4d2c-86c2-1783b516a407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:37.900943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27050fab-4c23-4d2c-86c2-1783b516a407 admin admin] PATH_INFO: `/v3/projects/becf1f073ec94fb5ac1738eb366c5070/users/739eecd8f5ff420aa04549cd81170535/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:37.902954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.933798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 847/1674] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:38:37.937126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050fab-4c23-4d2c-86c2-1783b516a407 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becf1f073ec94fb5ac1738eb366c5070, user_id=739eecd8f5ff420aa04549cd81170535, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:37.940082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27050fab-4c23-4d2c-86c2-1783b516a407 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:37.940976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:37.975901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ce3e8-303f-49c8-b9a4-36fdcfe3b331 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:37.993858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 828/1675] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:37 2022] PUT /identity/v3/projects/becf1f073ec94fb5ac1738eb366c5070/users/739eecd8f5ff420aa04549cd81170535/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:37.995144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050fab-4c23-4d2c-86c2-1783b516a407 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.105908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.212689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7e3b-f6dc-4c7f-931d-c1526427ae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.217364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7e3b-f6dc-4c7f-931d-c1526427ae3c admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.218006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7e3b-f6dc-4c7f-931d-c1526427ae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.218503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5b7e3b-f6dc-4c7f-931d-c1526427ae3c admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.220670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7e3b-f6dc-4c7f-931d-c1526427ae3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.223497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27050fab-4c23-4d2c-86c2-1783b516a407 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.231063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5b7e3b-f6dc-4c7f-931d-c1526427ae3c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.249561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.249561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.249561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.269997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.271230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.284115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.321785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 829/1676] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:38.323068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.325386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:38.345770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 848/1677] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:37 2022] POST /identity/v3/projects => generated 365 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:38.347614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7e3b-f6dc-4c7f-931d-c1526427ae3c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.358323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb14c12e-17df-4be6-b58c-8800b9fb3128 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.446709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.447304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.447662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.448629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] PATH_INFO: `/v3/projects/b3a4b47e6ffc49ea8b209c09d56dfc6f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.451034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3a4b47e6ffc49ea8b209c09d56dfc6f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.453431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.557706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5b7e3b-f6dc-4c7f-931d-c1526427ae3c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.571210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3a4b47e6ffc49ea8b209c09d56dfc6f', 'request_id': 'req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:38.584546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3a4b47e6ffc49ea8b209c09d56dfc6f', 'request_id': 'req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:38.609805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3a4b47e6ffc49ea8b209c09d56dfc6f', 'request_id': 'req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:38.628903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] The token cache is being invalidate because project b3a4b47e6ffc49ea8b209c09d56dfc6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:38.629174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:38.633238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:38.635193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 830/1678] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:38 2022] DELETE /identity/v3/projects/b3a4b47e6ffc49ea8b209c09d56dfc6f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:38.637132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.640635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:38.716423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.719359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.719359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.719359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] PATH_INFO: `/v3/projects/becf1f073ec94fb5ac1738eb366c5070/users/739eecd8f5ff420aa04549cd81170535/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.721761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=becf1f073ec94fb5ac1738eb366c5070, user_id=739eecd8f5ff420aa04549cd81170535, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.728570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.748198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 849/1679] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:38 2022] PUT /identity/v3/projects/becf1f073ec94fb5ac1738eb366c5070/users/739eecd8f5ff420aa04549cd81170535/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:38.749307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:38.752082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:38.753767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd0d38d-8e56-4c9a-853a-e84e73242bb4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.759498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.795240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:38.871334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a8841-64bf-475d-84ee-a0477fb638ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.872003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a8841-64bf-475d-84ee-a0477fb638ac admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.872201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a8841-64bf-475d-84ee-a0477fb638ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.874005 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a8841-64bf-475d-84ee-a0477fb638ac admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.875069 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a8841-64bf-475d-84ee-a0477fb638ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.877807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a8841-64bf-475d-84ee-a0477fb638ac admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.931667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 831/1680] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:38 2022] POST /identity/v3/users => generated 283 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:38.934442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893376-09a2-4d51-aa31-a01fa6eed6b3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.935325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893376-09a2-4d51-aa31-a01fa6eed6b3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.936438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20893376-09a2-4d51-aa31-a01fa6eed6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.967425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f3efb3-97ae-4db2-9bd2-80fc2d10ea99 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:38.980057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:38.980957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:38.981063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:38.981270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] PATH_INFO: `/v3/users/751eefe0727e498a84696dfd1cabe8a5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:38.983831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=751eefe0727e498a84696dfd1cabe8a5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:38.985819 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:38.986669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-20893376-09a2-4d51-aa31-a01fa6eed6b3 None None] MFA Rules not processed for user `739eecd8f5ff420aa04549cd81170535`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:38.988387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-20893376-09a2-4d51-aa31-a01fa6eed6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:39.099000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751eefe0727e498a84696dfd1cabe8a5'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:39.099858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751eefe0727e498a84696dfd1cabe8a5'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:39.117995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751eefe0727e498a84696dfd1cabe8a5'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:39.128694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751eefe0727e498a84696dfd1cabe8a5'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:39.134348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 832/1681] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:39.134348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893376-09a2-4d51-aa31-a01fa6eed6b3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.156470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20893376-09a2-4d51-aa31-a01fa6eed6b3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.171615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751eefe0727e498a84696dfd1cabe8a5'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:39.171801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.173222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.173594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.173895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.174676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.180727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.184701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 850/1682] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:38 2022] DELETE /identity/v3/users/751eefe0727e498a84696dfd1cabe8a5 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:39.185585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.186991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:39.197287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 833/1683] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:39.203945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.207840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:39.232539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b227dea8-01d8-4bf0-966f-5c1ae8b334ce admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.280743 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91e112b-3eb3-4005-ac05-27111d41a10f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.285496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3e90b-0990-4278-9140-2abc3672a029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.286380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e90b-0990-4278-9140-2abc3672a029 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.286887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e90b-0990-4278-9140-2abc3672a029 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.287303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3e90b-0990-4278-9140-2abc3672a029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.289394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6ed3e90b-0990-4278-9140-2abc3672a029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:39.351634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af344a-ddd3-4d9a-a944-19ec9d68ede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.352541 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af344a-ddd3-4d9a-a944-19ec9d68ede4 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.353723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af344a-ddd3-4d9a-a944-19ec9d68ede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.354217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af344a-ddd3-4d9a-a944-19ec9d68ede4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.354890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af344a-ddd3-4d9a-a944-19ec9d68ede4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.356528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af344a-ddd3-4d9a-a944-19ec9d68ede4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.369113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:39.378212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 834/1684] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:39.385929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af344a-ddd3-4d9a-a944-19ec9d68ede4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.411104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af344a-ddd3-4d9a-a944-19ec9d68ede4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:39.416064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3e90b-0990-4278-9140-2abc3672a029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.417888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3e90b-0990-4278-9140-2abc3672a029 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.425742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:39.426467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.426740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.427013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] PATH_INFO: `/v3/projects/39da729c0e584881b5930592e1daefd5/users/b178ac1020304c97b4788110a48950d4/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.434773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:39.439996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 851/1685] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:39 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:39.479214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39da729c0e584881b5930592e1daefd5, user_id=b178ac1020304c97b4788110a48950d4, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:39.482135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:39.528702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 835/1686] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:39 2022] PUT /identity/v3/projects/39da729c0e584881b5930592e1daefd5/users/b178ac1020304c97b4788110a48950d4/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:39.539143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fd46e-5474-4400-8e31-11230afff668 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:39.539429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fd46e-5474-4400-8e31-11230afff668 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:39.539705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fd46e-5474-4400-8e31-11230afff668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:39.630872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1e2fd46e-5474-4400-8e31-11230afff668 None None] MFA Rules not processed for user `b178ac1020304c97b4788110a48950d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:39.631947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1e2fd46e-5474-4400-8e31-11230afff668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:39.768295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.776559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:39.832601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 852/1687] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:39.837934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fd46e-5474-4400-8e31-11230afff668 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:39.990970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7bd4f9-24cd-4574-8f26-f08155f647e3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.005057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.007150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.007674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.008817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] PATH_INFO: `/v3/projects/4ec000987cc740cebff2ec054610bf30` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.012491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ec000987cc740cebff2ec054610bf30)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.014285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fd46e-5474-4400-8e31-11230afff668 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.017365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.030060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59fed5-82ee-41c8-8d2d-80dea3650118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.035284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59fed5-82ee-41c8-8d2d-80dea3650118 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.037624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59fed5-82ee-41c8-8d2d-80dea3650118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.038863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc59fed5-82ee-41c8-8d2d-80dea3650118 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.040325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59fed5-82ee-41c8-8d2d-80dea3650118 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.048415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc59fed5-82ee-41c8-8d2d-80dea3650118 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.138939 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 853/1688] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:39 2022] POST /identity/v3/projects => generated 365 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:40.142430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59fed5-82ee-41c8-8d2d-80dea3650118 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.152642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ec000987cc740cebff2ec054610bf30', 'request_id': 'req-1f156b6e-3e32-40e9-9272-15c427aa0566'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:40.184532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ec000987cc740cebff2ec054610bf30', 'request_id': 'req-1f156b6e-3e32-40e9-9272-15c427aa0566'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:40.218756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ec000987cc740cebff2ec054610bf30', 'request_id': 'req-1f156b6e-3e32-40e9-9272-15c427aa0566'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:40.248372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] The token cache is being invalidate because project 4ec000987cc740cebff2ec054610bf30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:40.251423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:40.253928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1f156b6e-3e32-40e9-9272-15c427aa0566 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:40.257735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 836/1689] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:39 2022] DELETE /identity/v3/projects/4ec000987cc740cebff2ec054610bf30 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:40.263063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2a670-c1b5-4ca2-9dbd-e8279d2da0a7 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.263896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2a670-c1b5-4ca2-9dbd-e8279d2da0a7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.264245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e2a670-c1b5-4ca2-9dbd-e8279d2da0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.301031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:40.311542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc59fed5-82ee-41c8-8d2d-80dea3650118 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.312580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c5e2a670-c1b5-4ca2-9dbd-e8279d2da0a7 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:40.317716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c5e2a670-c1b5-4ca2-9dbd-e8279d2da0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:40.328739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.329718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.330172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.330605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.331674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.340504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.340946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 837/1690] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:40.348373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591252-160e-469f-b2ab-01c45e32fd32 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.348794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591252-160e-469f-b2ab-01c45e32fd32 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.349227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01591252-160e-469f-b2ab-01c45e32fd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.385162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-01591252-160e-469f-b2ab-01c45e32fd32 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:40.400368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-01591252-160e-469f-b2ab-01c45e32fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:40.404369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 854/1691] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:40 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:38:40.406690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.413595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:40.423037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 838/1692] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:38:40.427336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01591252-160e-469f-b2ab-01c45e32fd32 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.449396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60860410-9c30-4d0f-9b41-34461165a0ca admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.453561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01591252-160e-469f-b2ab-01c45e32fd32 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.461869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6d7a3-1c9c-4506-8d11-5a62bad5677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.466207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6d7a3-1c9c-4506-8d11-5a62bad5677c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.467941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.468863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.469067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6d7a3-1c9c-4506-8d11-5a62bad5677c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.469415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6d7a3-1c9c-4506-8d11-5a62bad5677c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.470169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6d7a3-1c9c-4506-8d11-5a62bad5677c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.470693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.471173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.473174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:40.473760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.475952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6d7a3-1c9c-4506-8d11-5a62bad5677c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.478417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.514773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 855/1693] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:40.517747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 839/1694] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:40.518923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.519029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6d7a3-1c9c-4506-8d11-5a62bad5677c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.543860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960d6520-b865-44b5-8050-c9080ef3ee73 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.545045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6d7a3-1c9c-4506-8d11-5a62bad5677c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.557613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec005394-838e-400e-9b14-d951b2b72dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.557613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005394-838e-400e-9b14-d951b2b72dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.557613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005394-838e-400e-9b14-d951b2b72dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.557613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec005394-838e-400e-9b14-d951b2b72dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.558081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec005394-838e-400e-9b14-d951b2b72dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.564146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec005394-838e-400e-9b14-d951b2b72dc8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.565672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067feeb3-d55e-46a6-a0e7-db8422bb7480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.577415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067feeb3-d55e-46a6-a0e7-db8422bb7480 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.580333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067feeb3-d55e-46a6-a0e7-db8422bb7480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.580808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067feeb3-d55e-46a6-a0e7-db8422bb7480 admin admin] PATH_INFO: `/v3/projects/1eb146e98c15448595127881a4d40af9/users/ff575caec4074d748ebf3518d8be05ad/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.618955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067feeb3-d55e-46a6-a0e7-db8422bb7480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb146e98c15448595127881a4d40af9, user_id=ff575caec4074d748ebf3518d8be05ad, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.626585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067feeb3-d55e-46a6-a0e7-db8422bb7480 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.638737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 840/1695] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:40 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:40.643531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec005394-838e-400e-9b14-d951b2b72dc8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.663950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 856/1696] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:40 2022] PUT /identity/v3/projects/1eb146e98c15448595127881a4d40af9/users/ff575caec4074d748ebf3518d8be05ad/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:38:40.667984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067feeb3-d55e-46a6-a0e7-db8422bb7480 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:40.729693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:40.815719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec005394-838e-400e-9b14-d951b2b72dc8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.864671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067feeb3-d55e-46a6-a0e7-db8422bb7480 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:40.888098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91754ae8-0b24-44dd-a05a-612c47bc42e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.890894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91754ae8-0b24-44dd-a05a-612c47bc42e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.891630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91754ae8-0b24-44dd-a05a-612c47bc42e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.893509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91754ae8-0b24-44dd-a05a-612c47bc42e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.894285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91754ae8-0b24-44dd-a05a-612c47bc42e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.897708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91754ae8-0b24-44dd-a05a-612c47bc42e2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.924957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 857/1697] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:38:40.930126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa323f8-7c57-43c2-a42e-c98b48aec2ad None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.930699 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa323f8-7c57-43c2-a42e-c98b48aec2ad None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.930699 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa323f8-7c57-43c2-a42e-c98b48aec2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.953451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49bca7d-3ec2-48fe-ace1-ca63f05c7a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:40.954408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bca7d-3ec2-48fe-ace1-ca63f05c7a0f admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.954934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bca7d-3ec2-48fe-ace1-ca63f05c7a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.955353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49bca7d-3ec2-48fe-ace1-ca63f05c7a0f admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.956258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bca7d-3ec2-48fe-ace1-ca63f05c7a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:40.961082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49bca7d-3ec2-48fe-ace1-ca63f05c7a0f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:40.994374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 841/1698] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:40 2022] POST /identity/v3/users => generated 294 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:40.995941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eab86-e757-422c-a8c8-62abc5e5c741 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:40.996465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eab86-e757-422c-a8c8-62abc5e5c741 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:40.997221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5eab86-e757-422c-a8c8-62abc5e5c741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:40.997937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-baa323f8-7c57-43c2-a42e-c98b48aec2ad None None] MFA Rules not processed for user `36644d90057e4dd78064bd0a11627275`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:40.999226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-baa323f8-7c57-43c2-a42e-c98b48aec2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.046150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bf5eab86-e757-422c-a8c8-62abc5e5c741 None None] MFA Rules not processed for user `db949ab99ca14a788b2815e3ba59440c`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:41.061581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bf5eab86-e757-422c-a8c8-62abc5e5c741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.135466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 858/1699] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:41.136485 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa323f8-7c57-43c2-a42e-c98b48aec2ad None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.138696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-baa323f8-7c57-43c2-a42e-c98b48aec2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.152012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa323f8-7c57-43c2-a42e-c98b48aec2ad None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.156877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.158236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.158236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.158236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] PATH_INFO: `/v3/projects/7850890308e44a6e8720de27a0670c8c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.159268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7850890308e44a6e8720de27a0670c8c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.161256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.181494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 842/1700] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:41.183587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eab86-e757-422c-a8c8-62abc5e5c741 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.209853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5eab86-e757-422c-a8c8-62abc5e5c741 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.219180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.220023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.221597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.221930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.223437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] PATH_INFO: `/v3/projects/1eb146e98c15448595127881a4d40af9/users/ff575caec4074d748ebf3518d8be05ad/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.229226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb146e98c15448595127881a4d40af9, user_id=ff575caec4074d748ebf3518d8be05ad, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.235717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.241577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7850890308e44a6e8720de27a0670c8c', 'request_id': 'req-83f834f1-aec5-4f05-ba12-94e2c68ab63f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.248758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7850890308e44a6e8720de27a0670c8c', 'request_id': 'req-83f834f1-aec5-4f05-ba12-94e2c68ab63f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.260990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7850890308e44a6e8720de27a0670c8c', 'request_id': 'req-83f834f1-aec5-4f05-ba12-94e2c68ab63f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.261660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 843/1701] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:41 2022] PUT /identity/v3/projects/1eb146e98c15448595127881a4d40af9/users/ff575caec4074d748ebf3518d8be05ad/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:41.273584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.275837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.281476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] The token cache is being invalidate because project 7850890308e44a6e8720de27a0670c8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:41.281782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.282663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.284874 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 859/1702] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:41 2022] DELETE /identity/v3/projects/7850890308e44a6e8720de27a0670c8c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:41.291389 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.293683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.394824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f834f1-aec5-4f05-ba12-94e2c68ab63f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.399604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.446001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba189-ce5d-4d42-94a4-d5e0f820e25b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:41.458611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.459588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.459704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.459927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] PATH_INFO: `/v3/users/e4301d63bd1e44b1aaea8138c5ffe306` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.463608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4301d63bd1e44b1aaea8138c5ffe306)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.466772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.493180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb77d97-0dcb-4547-be53-35b8b112fa88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:41.494031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77d97-0dcb-4547-be53-35b8b112fa88 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.494460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77d97-0dcb-4547-be53-35b8b112fa88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.496502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb77d97-0dcb-4547-be53-35b8b112fa88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.497856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb77d97-0dcb-4547-be53-35b8b112fa88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:41.499897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb77d97-0dcb-4547-be53-35b8b112fa88 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:41.517707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 860/1703] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:41.519115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7c6ce-de93-47f7-9542-24035bfacce7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.519396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7c6ce-de93-47f7-9542-24035bfacce7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.519674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7c6ce-de93-47f7-9542-24035bfacce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.547197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3ec7c6ce-de93-47f7-9542-24035bfacce7 None None] MFA Rules not processed for user `36644d90057e4dd78064bd0a11627275`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:41.549268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3ec7c6ce-de93-47f7-9542-24035bfacce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.579581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4301d63bd1e44b1aaea8138c5ffe306'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.626658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4301d63bd1e44b1aaea8138c5ffe306'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.627813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4301d63bd1e44b1aaea8138c5ffe306'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.655572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4301d63bd1e44b1aaea8138c5ffe306'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.668153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 861/1704] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:41.668153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79959d0-b534-4c04-afdf-fe363df74319 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.668153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79959d0-b534-4c04-afdf-fe363df74319 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.668153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79959d0-b534-4c04-afdf-fe363df74319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.676609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-db2c84f7-3fef-47d5-974d-499452080eef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4301d63bd1e44b1aaea8138c5ffe306'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:41.686955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 844/1705] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:41 2022] DELETE /identity/v3/users/e4301d63bd1e44b1aaea8138c5ffe306 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:41.688623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c94bd-c9a7-4f04-8d9a-b65e28384ebb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.689235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c94bd-c9a7-4f04-8d9a-b65e28384ebb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.690254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c94bd-c9a7-4f04-8d9a-b65e28384ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.707165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f79959d0-b534-4c04-afdf-fe363df74319 None None] MFA Rules not processed for user `db949ab99ca14a788b2815e3ba59440c`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:41.708425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f79959d0-b534-4c04-afdf-fe363df74319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.718122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:41.759404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-088c94bd-c9a7-4f04-8d9a-b65e28384ebb None None] MFA Rules not processed for user `ff575caec4074d748ebf3518d8be05ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:41.761155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-088c94bd-c9a7-4f04-8d9a-b65e28384ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.831167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 862/1706] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:41.833623 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04520f46-bfd2-415f-806e-0108afc78088 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:41.834527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04520f46-bfd2-415f-806e-0108afc78088 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:41.834945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04520f46-bfd2-415f-806e-0108afc78088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:41.883466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-04520f46-bfd2-415f-806e-0108afc78088 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:41.884719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-04520f46-bfd2-415f-806e-0108afc78088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:41.908342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 845/1707] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:41.917756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c94bd-c9a7-4f04-8d9a-b65e28384ebb None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:41.920437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-088c94bd-c9a7-4f04-8d9a-b65e28384ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.015995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 863/1708] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:42.016889 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04520f46-bfd2-415f-806e-0108afc78088 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:42.024002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-04520f46-bfd2-415f-806e-0108afc78088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.038651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04520f46-bfd2-415f-806e-0108afc78088 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:42.049497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:42.050173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.050463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.050742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.051567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:42.054066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:42.058661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:42.090504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c94bd-c9a7-4f04-8d9a-b65e28384ebb None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:42.093757 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 864/1709] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:42.094311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:42.096943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.099825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c781ba-9713-4fb2-bc05-97297b1afa0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:42.100889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c781ba-9713-4fb2-bc05-97297b1afa0f service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.101359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c781ba-9713-4fb2-bc05-97297b1afa0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.101807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c781ba-9713-4fb2-bc05-97297b1afa0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.111457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e6c781ba-9713-4fb2-bc05-97297b1afa0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.270396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c438eca-e8bf-4f7e-bb78-55c71387fa30 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:42.272225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c781ba-9713-4fb2-bc05-97297b1afa0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:42.275583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c781ba-9713-4fb2-bc05-97297b1afa0f service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:42.287450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:42.289141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.289141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.289141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.293502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.297656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 846/1710] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:42.307604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c27b-3f38-4f7d-94f2-8b42cb26e205 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.308368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c27b-3f38-4f7d-94f2-8b42cb26e205 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.308825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c27b-3f38-4f7d-94f2-8b42cb26e205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.346025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0ae3c27b-3f38-4f7d-94f2-8b42cb26e205 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:42.347891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0ae3c27b-3f38-4f7d-94f2-8b42cb26e205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.383744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 847/1711] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:42.384780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3c27b-3f38-4f7d-94f2-8b42cb26e205 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:42.390848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0ae3c27b-3f38-4f7d-94f2-8b42cb26e205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.435760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3c27b-3f38-4f7d-94f2-8b42cb26e205 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:42.439246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:42.453272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49841a1b-a8f2-4f77-9c4f-bcd630889110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:42.454032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841a1b-a8f2-4f77-9c4f-bcd630889110 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.454382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841a1b-a8f2-4f77-9c4f-bcd630889110 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.454728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49841a1b-a8f2-4f77-9c4f-bcd630889110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.457222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-49841a1b-a8f2-4f77-9c4f-bcd630889110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.486694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:42.487526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49841a1b-a8f2-4f77-9c4f-bcd630889110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:42.488546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:42.495630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49841a1b-a8f2-4f77-9c4f-bcd630889110 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:42.519781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 865/1712] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:42 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:42.520561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:42.524715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.526979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 848/1713] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:42 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:42.528475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561b58-f65d-4473-94e1-77cc92da11aa None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.530400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561b58-f65d-4473-94e1-77cc92da11aa None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.530769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32561b58-f65d-4473-94e1-77cc92da11aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.566194 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f054c87-9797-43f6-852d-6639f319ad6b service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:42.577035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:42.577805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.577992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.578289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.613104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:42.615570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:42.625975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-32561b58-f65d-4473-94e1-77cc92da11aa None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:42.627452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-32561b58-f65d-4473-94e1-77cc92da11aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.651547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 849/1714] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:42.654448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 866/1715] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:42.655623 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:42.666924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32561b58-f65d-4473-94e1-77cc92da11aa None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:42.667288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:42.699510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32561b58-f65d-4473-94e1-77cc92da11aa None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:42.722348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2840a-4f12-4c4d-9ab2-833caf7bc377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:42.723184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2840a-4f12-4c4d-9ab2-833caf7bc377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:42.723395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2840a-4f12-4c4d-9ab2-833caf7bc377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:42.723890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2840a-4f12-4c4d-9ab2-833caf7bc377 admin admin] PATH_INFO: `/v3/projects/a0a3c2028b1649c298fd4c70373061cf/users/faaf13e05bda4e61b27779f022fefa76/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:42.774087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2840a-4f12-4c4d-9ab2-833caf7bc377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0a3c2028b1649c298fd4c70373061cf, user_id=faaf13e05bda4e61b27779f022fefa76, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:42.786173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2840a-4f12-4c4d-9ab2-833caf7bc377 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:42.823461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 850/1716] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:42 2022] PUT /identity/v3/projects/a0a3c2028b1649c298fd4c70373061cf/users/faaf13e05bda4e61b27779f022fefa76/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:42.823461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2840a-4f12-4c4d-9ab2-833caf7bc377 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:42.930188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6705a832-2e8a-489c-9bf5-f3a09cc8fe64 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:43.057254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2840a-4f12-4c4d-9ab2-833caf7bc377 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:43.071499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4fcb9-9db8-4499-9ec1-59972e0292b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:43.073013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4fcb9-9db8-4499-9ec1-59972e0292b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.078102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4fcb9-9db8-4499-9ec1-59972e0292b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.079821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4fcb9-9db8-4499-9ec1-59972e0292b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.080624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4fcb9-9db8-4499-9ec1-59972e0292b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:43.082061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4fcb9-9db8-4499-9ec1-59972e0292b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:43.085012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4fcb9-9db8-4499-9ec1-59972e0292b2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:43.095816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38df1-32f4-48b5-a8b4-5494e060538d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:43.096807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38df1-32f4-48b5-a8b4-5494e060538d service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.097702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38df1-32f4-48b5-a8b4-5494e060538d service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.098274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da38df1-32f4-48b5-a8b4-5494e060538d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.114241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da38df1-32f4-48b5-a8b4-5494e060538d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:43.117854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da38df1-32f4-48b5-a8b4-5494e060538d service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:43.140135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 851/1717] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:43.142159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e21fa-bffd-420e-a2c5-c77432627b42 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.143613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e21fa-bffd-420e-a2c5-c77432627b42 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.143891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 867/1718] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:43.144286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e21fa-bffd-420e-a2c5-c77432627b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.144897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38df1-32f4-48b5-a8b4-5494e060538d service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:43.203391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-da2e21fa-bffd-420e-a2c5-c77432627b42 None None] MFA Rules not processed for user `faaf13e05bda4e61b27779f022fefa76`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:43.205107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-da2e21fa-bffd-420e-a2c5-c77432627b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:43.260191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:43.332237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da38df1-32f4-48b5-a8b4-5494e060538d service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:43.338476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:43.339616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.339961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.340250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.342661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:43.407136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 852/1719] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:43.408137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e21fa-bffd-420e-a2c5-c77432627b42 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:43.434693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:43.452871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e21fa-bffd-420e-a2c5-c77432627b42 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:43.464901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7aa30-b1d1-4716-818e-3f033b5325f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:43.466844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7aa30-b1d1-4716-818e-3f033b5325f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.467466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7aa30-b1d1-4716-818e-3f033b5325f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.469376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f7aa30-b1d1-4716-818e-3f033b5325f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.470467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7aa30-b1d1-4716-818e-3f033b5325f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:43.473803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:43.478635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:43.479035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f7aa30-b1d1-4716-818e-3f033b5325f7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:43.524279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 868/1720] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:43.525140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:43.554710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 853/1721] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:43 2022] POST /identity/v3/projects => generated 367 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:43.557984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7aa30-b1d1-4716-818e-3f033b5325f7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:43.561016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fefd565-e785-43e1-983e-edf3bc0c5eef service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:43.719624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f7aa30-b1d1-4716-818e-3f033b5325f7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:43.735355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1a51c-43f4-4020-b14e-599720f1e74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:43.736150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a51c-43f4-4020-b14e-599720f1e74a admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.736554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a51c-43f4-4020-b14e-599720f1e74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.737062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1a51c-43f4-4020-b14e-599720f1e74a admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.737817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1a51c-43f4-4020-b14e-599720f1e74a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:43.740625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a1a51c-43f4-4020-b14e-599720f1e74a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:43.757253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf05-0d76-442c-a4ae-362bf3b4be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:43.757253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf05-0d76-442c-a4ae-362bf3b4be05 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.757572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf05-0d76-442c-a4ae-362bf3b4be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.757734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03cf05-0d76-442c-a4ae-362bf3b4be05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.758611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03cf05-0d76-442c-a4ae-362bf3b4be05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:43.768834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03cf05-0d76-442c-a4ae-362bf3b4be05 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:43.797927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 854/1722] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:43 2022] POST /identity/v3/users => generated 284 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:43.799122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1a51c-43f4-4020-b14e-599720f1e74a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:43.837909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a1a51c-43f4-4020-b14e-599720f1e74a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:43.854982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956af99-b40a-481a-8923-8a9e82d8a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:43.857194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956af99-b40a-481a-8923-8a9e82d8a34e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:43.857194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956af99-b40a-481a-8923-8a9e82d8a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:43.857483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956af99-b40a-481a-8923-8a9e82d8a34e admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:43.858499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956af99-b40a-481a-8923-8a9e82d8a34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:43.861489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956af99-b40a-481a-8923-8a9e82d8a34e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:43.862671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 869/1723] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:43 2022] POST /identity/v3/projects => generated 385 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:43.863789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf05-0d76-442c-a4ae-362bf3b4be05 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:43.893935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 855/1724] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:43.898792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956af99-b40a-481a-8923-8a9e82d8a34e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:43.928376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956af99-b40a-481a-8923-8a9e82d8a34e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.104130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917af260-e093-4710-b71b-f839dd4a4b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.104130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af260-e093-4710-b71b-f839dd4a4b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.104130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af260-e093-4710-b71b-f839dd4a4b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.104130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917af260-e093-4710-b71b-f839dd4a4b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.104568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917af260-e093-4710-b71b-f839dd4a4b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.106301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917af260-e093-4710-b71b-f839dd4a4b55 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.125178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03cf05-0d76-442c-a4ae-362bf3b4be05 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.131955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 856/1725] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:43 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:44.133076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917af260-e093-4710-b71b-f839dd4a4b55 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.149066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917af260-e093-4710-b71b-f839dd4a4b55 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.155032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948c322-d19a-47f3-be46-34650321cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.155715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c322-d19a-47f3-be46-34650321cc29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.156007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c322-d19a-47f3-be46-34650321cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.157214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948c322-d19a-47f3-be46-34650321cc29 admin admin] PATH_INFO: `/v3/projects/63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4/users/decfc0c3478346e3bf8e2018a739ec55/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.161232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052fc0-fccd-478f-b3fd-596e74c35f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.162604 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052fc0-fccd-478f-b3fd-596e74c35f6b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.162891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052fc0-fccd-478f-b3fd-596e74c35f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.163181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92052fc0-fccd-478f-b3fd-596e74c35f6b admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.172114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92052fc0-fccd-478f-b3fd-596e74c35f6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.173044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92052fc0-fccd-478f-b3fd-596e74c35f6b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.210144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948c322-d19a-47f3-be46-34650321cc29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4, user_id=decfc0c3478346e3bf8e2018a739ec55, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.214521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948c322-d19a-47f3-be46-34650321cc29 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.217430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.249954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 857/1726] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:44 2022] PUT /identity/v3/projects/63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4/users/decfc0c3478346e3bf8e2018a739ec55/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:38:44.257191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 870/1727] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:43 2022] POST /identity/v3/users => generated 299 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:44.259057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4aaf-1304-41f2-bcbb-9153a722122e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.259910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4aaf-1304-41f2-bcbb-9153a722122e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.260332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a4aaf-1304-41f2-bcbb-9153a722122e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.262153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052fc0-fccd-478f-b3fd-596e74c35f6b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.285093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92052fc0-fccd-478f-b3fd-596e74c35f6b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.308240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-911a4aaf-1304-41f2-bcbb-9153a722122e None None] MFA Rules not processed for user `decfc0c3478346e3bf8e2018a739ec55`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:44.311234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-911a4aaf-1304-41f2-bcbb-9153a722122e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:44.435471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.463230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aec6a9-0fdc-4f87-9b11-38c2e960b900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.464417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec6a9-0fdc-4f87-9b11-38c2e960b900 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.464883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec6a9-0fdc-4f87-9b11-38c2e960b900 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.465272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aec6a9-0fdc-4f87-9b11-38c2e960b900 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.466836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aec6a9-0fdc-4f87-9b11-38c2e960b900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.468936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aec6a9-0fdc-4f87-9b11-38c2e960b900 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.476638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 858/1728] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:44.478353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375a5f-b03d-484b-98b8-87ff3c680552 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.478756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375a5f-b03d-484b-98b8-87ff3c680552 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.478924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6375a5f-b03d-484b-98b8-87ff3c680552 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.480416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 859/1729] 10.222.0.88 () {54 vars in 912 bytes} [Fri Aug 26 00:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:44.486904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fd0e-3277-4af2-b082-a5b690ca9a01 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.487374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fd0e-3277-4af2-b082-a5b690ca9a01 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.487954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94fd0e-3277-4af2-b082-a5b690ca9a01 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.502161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 871/1730] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:38:44.502839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 860/1731] 10.222.0.88 () {54 vars in 912 bytes} [Fri Aug 26 00:38:44 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:44.503942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fd0e-3277-4af2-b082-a5b690ca9a01 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.505400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746aee-f4c7-4309-9cb0-0632da627503 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.506624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746aee-f4c7-4309-9cb0-0632da627503 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.507172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc746aee-f4c7-4309-9cb0-0632da627503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.529951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94fd0e-3277-4af2-b082-a5b690ca9a01 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.550464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09422c57-8048-4ad7-9848-a47b07e291ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.551182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09422c57-8048-4ad7-9848-a47b07e291ea admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.552964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09422c57-8048-4ad7-9848-a47b07e291ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.553401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09422c57-8048-4ad7-9848-a47b07e291ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.554452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09422c57-8048-4ad7-9848-a47b07e291ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.562415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09422c57-8048-4ad7-9848-a47b07e291ea admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.586819 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cc746aee-f4c7-4309-9cb0-0632da627503 None None] MFA Rules not processed for user `266a34590c4645ffa4c1c4afe3a9970d`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:44.588649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cc746aee-f4c7-4309-9cb0-0632da627503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:44.605609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 861/1732] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:44 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:44.607522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c77cd-88ba-42d7-bfa7-3e6571cb88c3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.607939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c77cd-88ba-42d7-bfa7-3e6571cb88c3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.608448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c77cd-88ba-42d7-bfa7-3e6571cb88c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.668586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2d7c77cd-88ba-42d7-bfa7-3e6571cb88c3 None None] MFA Rules not processed for user `a0e9262597de4799a64977e44b41e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:44.670358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2d7c77cd-88ba-42d7-bfa7-3e6571cb88c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:44.692353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 872/1733] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:44.694738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746aee-f4c7-4309-9cb0-0632da627503 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.696447 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cc746aee-f4c7-4309-9cb0-0632da627503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:44.711892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc746aee-f4c7-4309-9cb0-0632da627503 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.744018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 862/1734] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:38:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:44.745419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c77cd-88ba-42d7-bfa7-3e6571cb88c3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.812121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.812896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.813187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.813462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] PATH_INFO: `/v3/projects/594e163f66a44710a2346ed2237e53a8` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.814871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] RBAC: Authorizing `identity:delete_project(project_id=594e163f66a44710a2346ed2237e53a8)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.816989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.830417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:44.837248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c77cd-88ba-42d7-bfa7-3e6571cb88c3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:44.846168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dcb2d3-f0bc-4a58-9f64-1da1f107471d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:44.846968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb2d3-f0bc-4a58-9f64-1da1f107471d admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.847255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb2d3-f0bc-4a58-9f64-1da1f107471d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.847638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dcb2d3-f0bc-4a58-9f64-1da1f107471d admin admin] PATH_INFO: `/v3/projects/695dc1b1f3e7483fa36868130019d28f/users/0cb1db981abd418b9faeefa8872685c3/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.868308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcb2d3-f0bc-4a58-9f64-1da1f107471d admin admin] RBAC: Authorizing `identity:create_grant(project_id=695dc1b1f3e7483fa36868130019d28f, user_id=0cb1db981abd418b9faeefa8872685c3, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:44.870807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '594e163f66a44710a2346ed2237e53a8', 'request_id': 'req-0cd262b6-c944-4095-8849-903192b9b78b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:44.872947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dcb2d3-f0bc-4a58-9f64-1da1f107471d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:44.877305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '594e163f66a44710a2346ed2237e53a8', 'request_id': 'req-0cd262b6-c944-4095-8849-903192b9b78b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:44.888469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '594e163f66a44710a2346ed2237e53a8', 'request_id': 'req-0cd262b6-c944-4095-8849-903192b9b78b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:44.894105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 863/1735] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:44 2022] PUT /identity/v3/projects/695dc1b1f3e7483fa36868130019d28f/users/0cb1db981abd418b9faeefa8872685c3/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:44.895294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bf9e3-a680-4716-a39e-ee76d0768b0f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:44.895583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bf9e3-a680-4716-a39e-ee76d0768b0f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:44.895952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826bf9e3-a680-4716-a39e-ee76d0768b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:44.904451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] The token cache is being invalidate because project 594e163f66a44710a2346ed2237e53a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:44.904814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:44.906369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:44.908807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 873/1736] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:44 2022] DELETE /identity/v3/projects/594e163f66a44710a2346ed2237e53a8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:44.909818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:44.914099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:44.921404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-826bf9e3-a680-4716-a39e-ee76d0768b0f None None] MFA Rules not processed for user `a0e9262597de4799a64977e44b41e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:44.923682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-826bf9e3-a680-4716-a39e-ee76d0768b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:44.938156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:45.017811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd262b6-c944-4095-8849-903192b9b78b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.034150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 864/1737] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:38:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:45.035883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bf9e3-a680-4716-a39e-ee76d0768b0f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.037615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-826bf9e3-a680-4716-a39e-ee76d0768b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:45.052547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826bf9e3-a680-4716-a39e-ee76d0768b0f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.060658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.061657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.061989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.062270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.066496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:45.083204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.088450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.100948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 865/1738] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:45.101794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.104003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:45.107120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c58041-396e-400d-9aa5-e2b9587e9902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.108366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c58041-396e-400d-9aa5-e2b9587e9902 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.108758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c58041-396e-400d-9aa5-e2b9587e9902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.109598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c58041-396e-400d-9aa5-e2b9587e9902 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.110831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c58041-396e-400d-9aa5-e2b9587e9902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.117266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c58041-396e-400d-9aa5-e2b9587e9902 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.121749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed3c94b-fcad-4bea-a8f1-beae3e756dfc service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.127368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f9328-f86f-4a2f-933e-73d10c117d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.128166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9328-f86f-4a2f-933e-73d10c117d30 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.128574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9328-f86f-4a2f-933e-73d10c117d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.129123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f9328-f86f-4a2f-933e-73d10c117d30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.129839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f9328-f86f-4a2f-933e-73d10c117d30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.132256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84f9328-f86f-4a2f-933e-73d10c117d30 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.145859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 866/1739] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:45.148045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875327-3ba4-46f6-9e8b-ac477fc92e75 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.148354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875327-3ba4-46f6-9e8b-ac477fc92e75 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.148727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21875327-3ba4-46f6-9e8b-ac477fc92e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.150772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 874/1740] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:44 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:45.151941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c58041-396e-400d-9aa5-e2b9587e9902 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.172378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c58041-396e-400d-9aa5-e2b9587e9902 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.180591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3fdf7-42b6-4446-a4f2-b77259d852f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.181234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3fdf7-42b6-4446-a4f2-b77259d852f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.181516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3fdf7-42b6-4446-a4f2-b77259d852f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.181790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3fdf7-42b6-4446-a4f2-b77259d852f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.182808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-21875327-3ba4-46f6-9e8b-ac477fc92e75 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:45.184565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-21875327-3ba4-46f6-9e8b-ac477fc92e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:45.194905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3fdf7-42b6-4446-a4f2-b77259d852f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.197018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3fdf7-42b6-4446-a4f2-b77259d852f3 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.206470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 867/1741] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:45.207369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875327-3ba4-46f6-9e8b-ac477fc92e75 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.220460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 875/1742] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:45.221291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3fdf7-42b6-4446-a4f2-b77259d852f3 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.228903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21875327-3ba4-46f6-9e8b-ac477fc92e75 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.241275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe1b3-0f60-487b-a235-1cb7f50b2fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.242121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe1b3-0f60-487b-a235-1cb7f50b2fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.242238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe1b3-0f60-487b-a235-1cb7f50b2fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.242515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe1b3-0f60-487b-a235-1cb7f50b2fd7 admin admin] PATH_INFO: `/v3/projects/695dc1b1f3e7483fa36868130019d28f/users/0cb1db981abd418b9faeefa8872685c3/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.244639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3fdf7-42b6-4446-a4f2-b77259d852f3 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.247054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe1b3-0f60-487b-a235-1cb7f50b2fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=695dc1b1f3e7483fa36868130019d28f, user_id=0cb1db981abd418b9faeefa8872685c3, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.251262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe1b3-0f60-487b-a235-1cb7f50b2fd7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.259038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fe0e6-8224-4424-9733-40b438fc37e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.259709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fe0e6-8224-4424-9733-40b438fc37e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.259989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fe0e6-8224-4424-9733-40b438fc37e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.260263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19fe0e6-8224-4424-9733-40b438fc37e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.260918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fe0e6-8224-4424-9733-40b438fc37e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.263072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19fe0e6-8224-4424-9733-40b438fc37e4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.293259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 868/1743] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:45 2022] PUT /identity/v3/projects/695dc1b1f3e7483fa36868130019d28f/users/0cb1db981abd418b9faeefa8872685c3/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:45.293259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7084-103a-4966-878b-511cab1b5e23 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.293259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7084-103a-4966-878b-511cab1b5e23 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.293259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d7084-103a-4966-878b-511cab1b5e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.293786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 876/1744] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:45.296315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fe0e6-8224-4424-9733-40b438fc37e4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.345215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d02d7084-103a-4966-878b-511cab1b5e23 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:45.346705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d02d7084-103a-4966-878b-511cab1b5e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:45.350658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19fe0e6-8224-4424-9733-40b438fc37e4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.498564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098dac7-7d51-49cb-9efd-cba79f326a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.499372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098dac7-7d51-49cb-9efd-cba79f326a13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.499705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098dac7-7d51-49cb-9efd-cba79f326a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.499992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098dac7-7d51-49cb-9efd-cba79f326a13 admin admin] PATH_INFO: `/v3/projects/2d7caf500b4b47369d6a5d569c7a9c14/users/37032c0ba05d4d65ab88468f6f3c4c4d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.516460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 869/1745] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:45.518034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5209b3-9b04-4ede-a465-cd6ff84e1ac2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.518424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5209b3-9b04-4ede-a465-cd6ff84e1ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.518945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5209b3-9b04-4ede-a465-cd6ff84e1ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.551324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098dac7-7d51-49cb-9efd-cba79f326a13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7caf500b4b47369d6a5d569c7a9c14, user_id=37032c0ba05d4d65ab88468f6f3c4c4d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.555265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098dac7-7d51-49cb-9efd-cba79f326a13 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.578708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 877/1746] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:45 2022] PUT /identity/v3/projects/2d7caf500b4b47369d6a5d569c7a9c14/users/37032c0ba05d4d65ab88468f6f3c4c4d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:45.578708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098dac7-7d51-49cb-9efd-cba79f326a13 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.589232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:45.628115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5a5209b3-9b04-4ede-a465-cd6ff84e1ac2 None None] MFA Rules not processed for user `0cb1db981abd418b9faeefa8872685c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:45.629517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5a5209b3-9b04-4ede-a465-cd6ff84e1ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:45.740839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:45.749783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098dac7-7d51-49cb-9efd-cba79f326a13 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.773846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.774531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.774813 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.775098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.786230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:45.786230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.786230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.820601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 878/1747] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:45.824039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.843394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de024d49-83c1-45e7-a068-e31d54a8b910 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.849215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 870/1748] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:45.852335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5209b3-9b04-4ede-a465-cd6ff84e1ac2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.875156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.875375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.875663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.876606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.877236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.879482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.886424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5209b3-9b04-4ede-a465-cd6ff84e1ac2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:45.894822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 879/1749] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:45.896392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:45.900633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:45.903809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb325-7808-442e-beab-4f9789724396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:45.904440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb325-7808-442e-beab-4f9789724396 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:45.906050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb325-7808-442e-beab-4f9789724396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:45.906332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8eb325-7808-442e-beab-4f9789724396 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:45.906975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb325-7808-442e-beab-4f9789724396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:45.908906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8eb325-7808-442e-beab-4f9789724396 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:45.967410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 871/1750] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:45 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:45.974255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb325-7808-442e-beab-4f9789724396 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:46.026144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2f0cb-e044-4e88-80f0-dc7432b03031 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.214530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8eb325-7808-442e-beab-4f9789724396 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.215836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9ec35-8f59-467b-bc2d-4e303f50dbc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.216486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9ec35-8f59-467b-bc2d-4e303f50dbc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.216771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9ec35-8f59-467b-bc2d-4e303f50dbc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.217082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9ec35-8f59-467b-bc2d-4e303f50dbc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.234424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa8e5f-18ee-4f92-92cf-19735dc8e450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.235194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8e5f-18ee-4f92-92cf-19735dc8e450 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.236826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8e5f-18ee-4f92-92cf-19735dc8e450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.237117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8e5f-18ee-4f92-92cf-19735dc8e450 admin admin] PATH_INFO: `/v3/projects/2d7caf500b4b47369d6a5d569c7a9c14/users/37032c0ba05d4d65ab88468f6f3c4c4d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.242448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa8e5f-18ee-4f92-92cf-19735dc8e450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d7caf500b4b47369d6a5d569c7a9c14, user_id=37032c0ba05d4d65ab88468f6f3c4c4d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.248279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa8e5f-18ee-4f92-92cf-19735dc8e450 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.264566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 872/1751] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:45 2022] PUT /identity/v3/projects/2d7caf500b4b47369d6a5d569c7a9c14/users/37032c0ba05d4d65ab88468f6f3c4c4d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:46.265301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa8e5f-18ee-4f92-92cf-19735dc8e450 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:46.437473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:46.448999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9ec35-8f59-467b-bc2d-4e303f50dbc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.460275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9ec35-8f59-467b-bc2d-4e303f50dbc3 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.498592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 880/1752] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:45 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:46.501716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc907b-6910-487a-9910-643720d3fb03 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.502047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc907b-6910-487a-9910-643720d3fb03 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.502427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc907b-6910-487a-9910-643720d3fb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.504144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa8e5f-18ee-4f92-92cf-19735dc8e450 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.512160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.513554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.514085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.514520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.515478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.517733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.590828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c6bc907b-6910-487a-9910-643720d3fb03 None None] MFA Rules not processed for user `37032c0ba05d4d65ab88468f6f3c4c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:46.591548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c6bc907b-6910-487a-9910-643720d3fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:46.591706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 873/1753] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:46 2022] POST /identity/v3/users => generated 286 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:46.594159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:46.597722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:46.663521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:46.793214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68460b73-ff0a-41bd-9e76-49584724055e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.808338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664c0966-c1c7-475d-8452-6ea1a6061ee6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.809115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0966-c1c7-475d-8452-6ea1a6061ee6 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.809453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0966-c1c7-475d-8452-6ea1a6061ee6 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.809765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c0966-c1c7-475d-8452-6ea1a6061ee6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.812038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-664c0966-c1c7-475d-8452-6ea1a6061ee6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:46.820884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 881/1754] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:46.820884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc907b-6910-487a-9910-643720d3fb03 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:46.820884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c6bc907b-6910-487a-9910-643720d3fb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:46.916004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c0966-c1c7-475d-8452-6ea1a6061ee6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.919984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664c0966-c1c7-475d-8452-6ea1a6061ee6 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.938681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 874/1755] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:46.940092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb6b89-6149-4dd1-820c-95a15d6ca7d8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.940386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb6b89-6149-4dd1-820c-95a15d6ca7d8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.940781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb6b89-6149-4dd1-820c-95a15d6ca7d8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.947678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 875/1756] 10.222.0.88 () {54 vars in 961 bytes} [Fri Aug 26 00:38:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:46.948866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb6b89-6149-4dd1-820c-95a15d6ca7d8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:46.956260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc907b-6910-487a-9910-643720d3fb03 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.963538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.964299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.964588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.964868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.965384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb6b89-6149-4dd1-820c-95a15d6ca7d8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:46.972089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:46.974592 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7b70-39e6-43f9-80cf-f01032d12522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:46.976106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7b70-39e6-43f9-80cf-f01032d12522 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:46.976395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7b70-39e6-43f9-80cf-f01032d12522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:46.976673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ba7b70-39e6-43f9-80cf-f01032d12522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:46.977333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba7b70-39e6-43f9-80cf-f01032d12522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:46.980250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ba7b70-39e6-43f9-80cf-f01032d12522 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:46.999768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:47.003758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:47.006623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 876/1757] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:47.014206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7b70-39e6-43f9-80cf-f01032d12522 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:47.027964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 882/1758] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:47.044696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:47.046817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ba7b70-39e6-43f9-80cf-f01032d12522 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:47.049417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:47.077045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:47.079397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.081297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.084013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] PATH_INFO: `/v3/users/faaf13e05bda4e61b27779f022fefa76` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.087151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faaf13e05bda4e61b27779f022fefa76)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:47.087877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de157b0-345d-4cca-8238-4e3017bacf77 service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:47.092362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:47.103914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:47.104293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.104501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.104745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] PATH_INFO: `/v3/users/73efad448c654998ab769b39210849e0` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.108661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] RBAC: Authorizing `identity:delete_user(user_id=73efad448c654998ab769b39210849e0)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:47.110633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:47.240482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faaf13e05bda4e61b27779f022fefa76'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.245009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73efad448c654998ab769b39210849e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.245903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73efad448c654998ab769b39210849e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.268730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73efad448c654998ab769b39210849e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.280185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73efad448c654998ab769b39210849e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.283798 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faaf13e05bda4e61b27779f022fefa76'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.283987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:47.287180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faaf13e05bda4e61b27779f022fefa76'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.313847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73efad448c654998ab769b39210849e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.317915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faaf13e05bda4e61b27779f022fefa76'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.323192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 883/1759] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:47 2022] DELETE /identity/v3/users/73efad448c654998ab769b39210849e0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:47.327325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:47.328254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-837250e2-a048-4324-ae16-db23b4f3f3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faaf13e05bda4e61b27779f022fefa76'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:47.330846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:47.340832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 877/1760] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:47 2022] DELETE /identity/v3/users/faaf13e05bda4e61b27779f022fefa76 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:47.342050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf184f6-1c25-4197-aa15-4aae2bef0888 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.342441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf184f6-1c25-4197-aa15-4aae2bef0888 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.342819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf184f6-1c25-4197-aa15-4aae2bef0888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.383787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fdf184f6-1c25-4197-aa15-4aae2bef0888 None None] MFA Rules not processed for user `db949ab99ca14a788b2815e3ba59440c`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:47.398349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fdf184f6-1c25-4197-aa15-4aae2bef0888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:47.489030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:47.494510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e4cf2-dfe9-47dd-ab6f-8caf1e9b561a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:47.566082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 878/1761] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:47.566082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca266ca-a67f-4d13-a75e-9fc9dcbb7d13 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.566082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca266ca-a67f-4d13-a75e-9fc9dcbb7d13 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.566082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca266ca-a67f-4d13-a75e-9fc9dcbb7d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.623271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:47.624391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.624391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.624618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.626355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:47.652637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5ca266ca-a67f-4d13-a75e-9fc9dcbb7d13 None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:47.655068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5ca266ca-a67f-4d13-a75e-9fc9dcbb7d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:47.778777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:47.781426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:47.808686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 884/1762] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:47 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:47.809424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:47.827592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:47.893819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 879/1763] 10.222.0.88 () {58 vars in 1058 bytes} [Fri Aug 26 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:47.895231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2cd8-8a44-4867-bb4d-5eff0442248f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:47.895792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2cd8-8a44-4867-bb4d-5eff0442248f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:47.895972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ca2cd8-8a44-4867-bb4d-5eff0442248f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:47.944840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e9ca2cd8-8a44-4867-bb4d-5eff0442248f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:47.946452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e9ca2cd8-8a44-4867-bb4d-5eff0442248f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.071349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:48.096066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 880/1764] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:48.096066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc6fe-a007-4f9b-bcfb-3794e5c07c86 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.096066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc6fe-a007-4f9b-bcfb-3794e5c07c86 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.096066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dc6fe-a007-4f9b-bcfb-3794e5c07c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.132734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15980bc3-2772-4626-940a-7f2add4cf976 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.139173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1b1dc6fe-a007-4f9b-bcfb-3794e5c07c86 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:48.144826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1b1dc6fe-a007-4f9b-bcfb-3794e5c07c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.149178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.149857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.154329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.154638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.155353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.157009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.163190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 881/1765] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:48.164669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc6fe-a007-4f9b-bcfb-3794e5c07c86 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.195042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dc6fe-a007-4f9b-bcfb-3794e5c07c86 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.196182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 885/1766] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:48.197789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.201490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.209785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.210611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.210995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.211579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.217052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.231074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a5f3d-2902-4d24-b235-980cce6cc8e6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.240661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.241750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.243543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.243930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.244300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.245386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.251459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.268105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 882/1767] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:48.272653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.275180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.384317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.387775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.402694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d886fba-7476-416d-b3ac-0264aacb1c21 service placement] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.409934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 886/1768] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:48.411688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.412563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.414144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.414144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.414298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.416440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.435750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:48.446272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.450510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660b6db-1d34-44c8-bae5-247e149385f7 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.452188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.457464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.458148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.458639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.459224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] PATH_INFO: `/v3/users/b178ac1020304c97b4788110a48950d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.461417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b178ac1020304c97b4788110a48950d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.463906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.483656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 883/1769] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:48.486555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.488184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.504542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc4522f-4f31-4a71-9107-47b0b40a3824 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.513402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c22b53-78d3-42e4-b29c-e0eb98d4a2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.514419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c22b53-78d3-42e4-b29c-e0eb98d4a2ac service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.514817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c22b53-78d3-42e4-b29c-e0eb98d4a2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.515108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c22b53-78d3-42e4-b29c-e0eb98d4a2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.539832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c22b53-78d3-42e4-b29c-e0eb98d4a2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.548645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c22b53-78d3-42e4-b29c-e0eb98d4a2ac service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.573179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b178ac1020304c97b4788110a48950d4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:48.574150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b178ac1020304c97b4788110a48950d4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:48.600977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 884/1770] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:48.602237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b178ac1020304c97b4788110a48950d4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:48.602371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c22b53-78d3-42e4-b29c-e0eb98d4a2ac service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.620721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b178ac1020304c97b4788110a48950d4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:48.621329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c22b53-78d3-42e4-b29c-e0eb98d4a2ac service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:48.628853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af977a-e0f9-4b42-93ce-9fac48c61caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:48.631150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af977a-e0f9-4b42-93ce-9fac48c61caf admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.631867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af977a-e0f9-4b42-93ce-9fac48c61caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.633194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af977a-e0f9-4b42-93ce-9fac48c61caf admin admin] PATH_INFO: `/v3/projects/b1c8cb6ee6054ae7aa3c8d583b556d01/users/ab683cbeb2504da5b5bc8a84c133ae80/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.657280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4b09c244-e44d-4a0c-9fef-9937ccd2efba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b178ac1020304c97b4788110a48950d4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:48.666157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 887/1771] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:48 2022] DELETE /identity/v3/users/b178ac1020304c97b4788110a48950d4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:48.670779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d06e-17c1-4def-977b-ab85dd219c03 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.671234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d06e-17c1-4def-977b-ab85dd219c03 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.671666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc5d06e-17c1-4def-977b-ab85dd219c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.696126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af977a-e0f9-4b42-93ce-9fac48c61caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c8cb6ee6054ae7aa3c8d583b556d01, user_id=ab683cbeb2504da5b5bc8a84c133ae80, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:48.703294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4fc5d06e-17c1-4def-977b-ab85dd219c03 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:48.703647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37af977a-e0f9-4b42-93ce-9fac48c61caf admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:48.715798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4fc5d06e-17c1-4def-977b-ab85dd219c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.762567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 885/1772] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:48 2022] PUT /identity/v3/projects/b1c8cb6ee6054ae7aa3c8d583b556d01/users/ab683cbeb2504da5b5bc8a84c133ae80/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:48.774840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306873-830f-4576-97ab-3be8880fedd6 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:48.775137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306873-830f-4576-97ab-3be8880fedd6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:48.775444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b306873-830f-4576-97ab-3be8880fedd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:48.856961 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9b306873-830f-4576-97ab-3be8880fedd6 None None] MFA Rules not processed for user `ab683cbeb2504da5b5bc8a84c133ae80`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:48.861808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9b306873-830f-4576-97ab-3be8880fedd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.865389 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:48.890571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 888/1773] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:48.952374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5d06e-17c1-4def-977b-ab85dd219c03 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:48.956381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4fc5d06e-17c1-4def-977b-ab85dd219c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:48.995732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 886/1774] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:49.000857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306873-830f-4576-97ab-3be8880fedd6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.008215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9b306873-830f-4576-97ab-3be8880fedd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:49.183427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc5d06e-17c1-4def-977b-ab85dd219c03 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.304689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b306873-830f-4576-97ab-3be8880fedd6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.315595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de50e9-e54d-423b-b577-e20f0368093c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.316412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de50e9-e54d-423b-b577-e20f0368093c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.316550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de50e9-e54d-423b-b577-e20f0368093c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.316909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de50e9-e54d-423b-b577-e20f0368093c admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.319026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de50e9-e54d-423b-b577-e20f0368093c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.324680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de50e9-e54d-423b-b577-e20f0368093c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.392489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 887/1775] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:48 2022] POST /identity/v3/projects => generated 373 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:49.396779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de50e9-e54d-423b-b577-e20f0368093c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.483152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08395af5-bd0d-4961-9225-fbcab20c0ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.483791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395af5-bd0d-4961-9225-fbcab20c0ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.484074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395af5-bd0d-4961-9225-fbcab20c0ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.484338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08395af5-bd0d-4961-9225-fbcab20c0ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.497542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:49.547307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08395af5-bd0d-4961-9225-fbcab20c0ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.559943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08395af5-bd0d-4961-9225-fbcab20c0ba4 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.633000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de50e9-e54d-423b-b577-e20f0368093c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.634092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 889/1776] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:49.645550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e6fe2-4800-4179-809a-8bce9109140e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.647091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e6fe2-4800-4179-809a-8bce9109140e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.651093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e6fe2-4800-4179-809a-8bce9109140e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.652748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e6fe2-4800-4179-809a-8bce9109140e admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.654471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e6fe2-4800-4179-809a-8bce9109140e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.663852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5e6fe2-4800-4179-809a-8bce9109140e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.795300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 888/1777] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:49 2022] POST /identity/v3/users => generated 293 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:38:49.796784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08395af5-bd0d-4961-9225-fbcab20c0ba4 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.810977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08395af5-bd0d-4961-9225-fbcab20c0ba4 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.835000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5a1d2-8921-4fb4-93e0-dd5126c75761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.835644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a1d2-8921-4fb4-93e0-dd5126c75761 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.835929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a1d2-8921-4fb4-93e0-dd5126c75761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.836206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c5a1d2-8921-4fb4-93e0-dd5126c75761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.836883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5a1d2-8921-4fb4-93e0-dd5126c75761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:49.838569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c5a1d2-8921-4fb4-93e0-dd5126c75761 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:49.893314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 890/1778] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:49.898121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e6fe2-4800-4179-809a-8bce9109140e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:49.920767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e6fe2-4800-4179-809a-8bce9109140e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:49.944289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:49.944887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:49.945175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:49.945452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] PATH_INFO: `/v3/projects/ab949ac1d52a4e19b061fd4bc80b8735/users/30e88718914b4607b5df03090f2394c9/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:49.998783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab949ac1d52a4e19b061fd4bc80b8735, user_id=30e88718914b4607b5df03090f2394c9, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.004877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.042303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 889/1779] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:49 2022] PUT /identity/v3/projects/ab949ac1d52a4e19b061fd4bc80b8735/users/30e88718914b4607b5df03090f2394c9/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:50.056594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5a1d2-8921-4fb4-93e0-dd5126c75761 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.071406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c5a1d2-8921-4fb4-93e0-dd5126c75761 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.250320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.252205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:50.252679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc447c-731d-4a8c-889d-84c3aba5f6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.253377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc447c-731d-4a8c-889d-84c3aba5f6d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.253758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc447c-731d-4a8c-889d-84c3aba5f6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.254128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc447c-731d-4a8c-889d-84c3aba5f6d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.254857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc447c-731d-4a8c-889d-84c3aba5f6d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.256941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc447c-731d-4a8c-889d-84c3aba5f6d8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.276652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f95a487-682e-4560-b3f4-4f22c00c75dc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.290445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.291767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.292457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.292917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] PATH_INFO: `/v3/projects/b1b293b88bc94d56a094a8fadd69f4d3` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.294890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1b293b88bc94d56a094a8fadd69f4d3)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.298727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 891/1780] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:50.301372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc447c-731d-4a8c-889d-84c3aba5f6d8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.306760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.328808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc447c-731d-4a8c-889d-84c3aba5f6d8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:50.346929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a928ca-0e71-4794-93f5-e14b1dc0d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:50.348003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a928ca-0e71-4794-93f5-e14b1dc0d806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.348442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a928ca-0e71-4794-93f5-e14b1dc0d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.349970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a928ca-0e71-4794-93f5-e14b1dc0d806 admin admin] PATH_INFO: `/v3/projects/ab949ac1d52a4e19b061fd4bc80b8735/users/30e88718914b4607b5df03090f2394c9/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.355493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a928ca-0e71-4794-93f5-e14b1dc0d806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab949ac1d52a4e19b061fd4bc80b8735, user_id=30e88718914b4607b5df03090f2394c9, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:50.365343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a928ca-0e71-4794-93f5-e14b1dc0d806 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:50.396922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 892/1781] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:50 2022] PUT /identity/v3/projects/ab949ac1d52a4e19b061fd4bc80b8735/users/30e88718914b4607b5df03090f2394c9/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:50.407753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bafcd-5e63-4637-ba3e-cb1741da3634 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:50.419044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bafcd-5e63-4637-ba3e-cb1741da3634 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:50.419641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28bafcd-5e63-4637-ba3e-cb1741da3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:50.443274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1b293b88bc94d56a094a8fadd69f4d3', 'request_id': 'req-295c265e-b105-4e96-b234-40ac6449e000'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:50.469923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1b293b88bc94d56a094a8fadd69f4d3', 'request_id': 'req-295c265e-b105-4e96-b234-40ac6449e000'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:50.504657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a28bafcd-5e63-4637-ba3e-cb1741da3634 None None] MFA Rules not processed for user `30e88718914b4607b5df03090f2394c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:50.507757 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a28bafcd-5e63-4637-ba3e-cb1741da3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:50.518388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1b293b88bc94d56a094a8fadd69f4d3', 'request_id': 'req-295c265e-b105-4e96-b234-40ac6449e000'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:50.562715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:50.606406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] The token cache is being invalidate because project b1b293b88bc94d56a094a8fadd69f4d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:50.609023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:50.615157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:50.641098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 890/1782] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:50 2022] DELETE /identity/v3/projects/b1b293b88bc94d56a094a8fadd69f4d3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:50.644759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.647858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:50.901150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 893/1783] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 494 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:38:50.915073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bafcd-5e63-4637-ba3e-cb1741da3634 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:50.922933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a28bafcd-5e63-4637-ba3e-cb1741da3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:51.027239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c265e-b105-4e96-b234-40ac6449e000 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.068100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.068717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.068999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.071997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] PATH_INFO: `/v3/users/739eecd8f5ff420aa04549cd81170535` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.076708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=739eecd8f5ff420aa04549cd81170535)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:51.078719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:51.218510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=84,keystone:INSERT=5,keystone:DELETE=11 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:51.245286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28bafcd-5e63-4637-ba3e-cb1741da3634 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.273390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.273390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.273731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.275541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.304292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '739eecd8f5ff420aa04549cd81170535'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.328550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:51.330634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:51.364105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '739eecd8f5ff420aa04549cd81170535'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.367753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '739eecd8f5ff420aa04549cd81170535'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.372548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 894/1784] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:51.398509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '739eecd8f5ff420aa04549cd81170535'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.415343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '739eecd8f5ff420aa04549cd81170535'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.429813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 891/1785] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:50 2022] DELETE /identity/v3/users/739eecd8f5ff420aa04549cd81170535 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:51.482782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:51.485030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:51.495031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:51.496733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:51.516641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca92e2a-f70b-4afa-88bb-5c4c5eb0faef service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.629444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c02c2-83fe-4d18-ba00-e2ae5d1c4f80 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:51.640613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.641171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.641458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.641738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] PATH_INFO: `/v3/projects/39da729c0e584881b5930592e1daefd5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.643382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39da729c0e584881b5930592e1daefd5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:51.647635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:51.648303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.648583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.649004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] PATH_INFO: `/v3/projects/a0a3c2028b1649c298fd4c70373061cf` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.650687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:51.651472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0a3c2028b1649c298fd4c70373061cf)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:51.653549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:51.800386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0a3c2028b1649c298fd4c70373061cf', 'request_id': 'req-2d28a5ac-25b5-4b1d-8991-5898c5037a87'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.806855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39da729c0e584881b5930592e1daefd5', 'request_id': 'req-544742a2-8230-4d95-9266-643720852c3d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.812404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:51.815322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39da729c0e584881b5930592e1daefd5', 'request_id': 'req-544742a2-8230-4d95-9266-643720852c3d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.824476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0a3c2028b1649c298fd4c70373061cf', 'request_id': 'req-2d28a5ac-25b5-4b1d-8991-5898c5037a87'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.833976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39da729c0e584881b5930592e1daefd5', 'request_id': 'req-544742a2-8230-4d95-9266-643720852c3d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.852136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0a3c2028b1649c298fd4c70373061cf', 'request_id': 'req-2d28a5ac-25b5-4b1d-8991-5898c5037a87'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.855254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] The token cache is being invalidate because project 39da729c0e584881b5930592e1daefd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:51.855769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.856645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.858645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 895/1786] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:51 2022] DELETE /identity/v3/projects/39da729c0e584881b5930592e1daefd5 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:51.859662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:51.862671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:51.870664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] The token cache is being invalidate because project a0a3c2028b1649c298fd4c70373061cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:51.871016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.872009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2d28a5ac-25b5-4b1d-8991-5898c5037a87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:51.877139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 892/1787] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:51 2022] DELETE /identity/v3/projects/a0a3c2028b1649c298fd4c70373061cf => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:51.877139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe8ee-5b04-4981-8a6e-c21bb698243f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:51.877139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe8ee-5b04-4981-8a6e-c21bb698243f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:51.877139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cbe8ee-5b04-4981-8a6e-c21bb698243f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:51.916528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-11cbe8ee-5b04-4981-8a6e-c21bb698243f None None] MFA Rules not processed for user `266a34590c4645ffa4c1c4afe3a9970d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:51.919259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-11cbe8ee-5b04-4981-8a6e-c21bb698243f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:51.955666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:52.004845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 893/1788] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:52.007043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74519-a3f9-4c33-af11-459da3ecf311 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.007332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74519-a3f9-4c33-af11-459da3ecf311 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.007608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74519-a3f9-4c33-af11-459da3ecf311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.077069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544742a2-8230-4d95-9266-643720852c3d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:52.077634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c0e74519-a3f9-4c33-af11-459da3ecf311 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:52.079520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c0e74519-a3f9-4c33-af11-459da3ecf311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:52.088152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:52.088794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.089084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.090916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.095307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:52.184322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 894/1789] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:38:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:52.185792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e74519-a3f9-4c33-af11-459da3ecf311 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:52.188286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c0e74519-a3f9-4c33-af11-459da3ecf311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:52.232355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:52.234058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:52.249263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 896/1790] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:52.250295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:52.252169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:52.374523 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e74519-a3f9-4c33-af11-459da3ecf311 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:52.381546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:52.382432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.382715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.383017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] PATH_INFO: `/v3/users/ff575caec4074d748ebf3518d8be05ad` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.384266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff575caec4074d748ebf3518d8be05ad)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:52.386461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:52.462966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff575caec4074d748ebf3518d8be05ad'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.466883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:52.483269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff575caec4074d748ebf3518d8be05ad'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.483945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff575caec4074d748ebf3518d8be05ad'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.502396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff575caec4074d748ebf3518d8be05ad'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.518280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff575caec4074d748ebf3518d8be05ad'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.525113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2615a4-0744-47db-a210-ce69a11011d9 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:52.535470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:52.536012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.537009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.537281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] PATH_INFO: `/v3/users/0cb1db981abd418b9faeefa8872685c3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.542822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 895/1791] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:52 2022] DELETE /identity/v3/users/ff575caec4074d748ebf3518d8be05ad => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:52.546377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cb1db981abd418b9faeefa8872685c3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:52.546910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:52.548487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:52.550402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:52.660558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:52.669334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cb1db981abd418b9faeefa8872685c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.670247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cb1db981abd418b9faeefa8872685c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.697220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cb1db981abd418b9faeefa8872685c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.698180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e50eb2-3c95-425b-b792-08ddee457e24 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:52.708615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:52.709469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.710460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.710853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] PATH_INFO: `/v3/projects/becf1f073ec94fb5ac1738eb366c5070` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:52.711063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cb1db981abd418b9faeefa8872685c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.714283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] RBAC: Authorizing `identity:delete_project(project_id=becf1f073ec94fb5ac1738eb366c5070)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:52.716816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:52.763809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cb1db981abd418b9faeefa8872685c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.795117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 897/1792] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:52 2022] DELETE /identity/v3/users/0cb1db981abd418b9faeefa8872685c3 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:52.799106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:52.800754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:52.898949 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'becf1f073ec94fb5ac1738eb366c5070', 'request_id': 'req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.930786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'becf1f073ec94fb5ac1738eb366c5070', 'request_id': 'req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.949775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'becf1f073ec94fb5ac1738eb366c5070', 'request_id': 'req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.978020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] The token cache is being invalidate because project becf1f073ec94fb5ac1738eb366c5070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:52.978711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.979926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ba6e0f68-1a1c-4f7b-89e5-79b53f75789f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:52.981944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 896/1793] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:52 2022] DELETE /identity/v3/projects/becf1f073ec94fb5ac1738eb366c5070 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:52.987997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8227b1-f789-44f8-a542-41dca7308e12 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:52.988607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8227b1-f789-44f8-a542-41dca7308e12 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:52.990362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8227b1-f789-44f8-a542-41dca7308e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.022578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cc8227b1-f789-44f8-a542-41dca7308e12 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:53.024757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cc8227b1-f789-44f8-a542-41dca7308e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:53.157810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:53.188588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 897/1794] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:53.189429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf63374-2583-46eb-a280-7f227795184e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.191012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2036-9e84-47d1-b648-3a109fe9832b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.191322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2036-9e84-47d1-b648-3a109fe9832b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.191556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f2036-9e84-47d1-b648-3a109fe9832b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.221693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e52f2036-9e84-47d1-b648-3a109fe9832b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:53.223312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e52f2036-9e84-47d1-b648-3a109fe9832b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:53.237449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 898/1795] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:53.238629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f2036-9e84-47d1-b648-3a109fe9832b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:53.253928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f2036-9e84-47d1-b648-3a109fe9832b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.260159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.262313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.262822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.263301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.264169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:53.264819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.267198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:53.289827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.291140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.291433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.291713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.294777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:53.304598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 899/1796] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:53.308381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:53.360284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e1927-4767-4620-832c-964999488d6e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.379869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:53.390658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505888a7-078f-45af-bc65-8b9261a61404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.391295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505888a7-078f-45af-bc65-8b9261a61404 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.391586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505888a7-078f-45af-bc65-8b9261a61404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.391862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505888a7-078f-45af-bc65-8b9261a61404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.392500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505888a7-078f-45af-bc65-8b9261a61404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.394667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505888a7-078f-45af-bc65-8b9261a61404 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:53.407960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.410035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:53.459211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 898/1797] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:38:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 663 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:38:53.531725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 900/1798] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:53 2022] POST /identity/v3/projects => generated 407 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:53.536072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:53.575197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c270ad8b-e664-4a98-97dc-8e1da46d67d2 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:53.984805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597eaab-ab00-4bc2-8748-35fbc3208a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:53.986385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597eaab-ab00-4bc2-8748-35fbc3208a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:53.986671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597eaab-ab00-4bc2-8748-35fbc3208a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:53.986942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597eaab-ab00-4bc2-8748-35fbc3208a12 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:53.987591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597eaab-ab00-4bc2-8748-35fbc3208a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:53.992531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597eaab-ab00-4bc2-8748-35fbc3208a12 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:54.040193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 899/1799] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:53 2022] POST /identity/v3/users => generated 304 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:54.041675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505888a7-078f-45af-bc65-8b9261a61404 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.058427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505888a7-078f-45af-bc65-8b9261a61404 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:54.102192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1ffd-157e-41a2-b33c-75c9f19a05b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:54.107168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1ffd-157e-41a2-b33c-75c9f19a05b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.107483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1ffd-157e-41a2-b33c-75c9f19a05b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.109807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a1ffd-157e-41a2-b33c-75c9f19a05b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.113449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a1ffd-157e-41a2-b33c-75c9f19a05b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:54.125467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a1ffd-157e-41a2-b33c-75c9f19a05b0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:54.170012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 901/1800] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:54.171778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597eaab-ab00-4bc2-8748-35fbc3208a12 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.193540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597eaab-ab00-4bc2-8748-35fbc3208a12 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:54.217411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dbfa9-5e5f-4930-9821-4ab57f57374b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:54.218236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbfa9-5e5f-4930-9821-4ab57f57374b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.218368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbfa9-5e5f-4930-9821-4ab57f57374b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.218600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dbfa9-5e5f-4930-9821-4ab57f57374b admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.219671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dbfa9-5e5f-4930-9821-4ab57f57374b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:54.224288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dbfa9-5e5f-4930-9821-4ab57f57374b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:54.262055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 900/1801] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:54.265229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1ffd-157e-41a2-b33c-75c9f19a05b0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.298813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a1ffd-157e-41a2-b33c-75c9f19a05b0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:54.308629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f669-bb15-460c-9554-8756ebfe6f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:54.310856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f669-bb15-460c-9554-8756ebfe6f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.311439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f669-bb15-460c-9554-8756ebfe6f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.311941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f669-bb15-460c-9554-8756ebfe6f81 admin admin] PATH_INFO: `/v3/projects/bac1af53228c47968848a02f73f31829/users/4383349cfea040169ee36d46186190f6/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.338738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585f669-bb15-460c-9554-8756ebfe6f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac1af53228c47968848a02f73f31829, user_id=4383349cfea040169ee36d46186190f6, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:54.349720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585f669-bb15-460c-9554-8756ebfe6f81 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:54.411185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 902/1802] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:54 2022] PUT /identity/v3/projects/bac1af53228c47968848a02f73f31829/users/4383349cfea040169ee36d46186190f6/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:54.423966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98bf71-2839-4478-8705-5669fa776ac6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:54.424612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98bf71-2839-4478-8705-5669fa776ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:54.424948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98bf71-2839-4478-8705-5669fa776ac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:54.537175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fc98bf71-2839-4478-8705-5669fa776ac6 None None] MFA Rules not processed for user `4383349cfea040169ee36d46186190f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:54.548813 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fc98bf71-2839-4478-8705-5669fa776ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:54.870690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 901/1803] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:54 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:54.871939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f669-bb15-460c-9554-8756ebfe6f81 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.997455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98bf71-2839-4478-8705-5669fa776ac6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:54.999328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fc98bf71-2839-4478-8705-5669fa776ac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:55.040522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f669-bb15-460c-9554-8756ebfe6f81 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.054565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74d86b-7e36-4bdc-9bf2-af301a2e5dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.056622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74d86b-7e36-4bdc-9bf2-af301a2e5dae admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.057690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74d86b-7e36-4bdc-9bf2-af301a2e5dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.058115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74d86b-7e36-4bdc-9bf2-af301a2e5dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.061361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74d86b-7e36-4bdc-9bf2-af301a2e5dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.067019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74d86b-7e36-4bdc-9bf2-af301a2e5dae admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.172471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 903/1804] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:54 2022] POST /identity/v3/projects => generated 409 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:55.181473 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74d86b-7e36-4bdc-9bf2-af301a2e5dae admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:55.191459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:55.224977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98bf71-2839-4478-8705-5669fa776ac6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.463906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.467130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.468790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.470648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] PATH_INFO: `/v3/projects/1eb146e98c15448595127881a4d40af9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.474976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb146e98c15448595127881a4d40af9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.477153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.487986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74d86b-7e36-4bdc-9bf2-af301a2e5dae admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.508009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba3a5-e25c-448a-983a-97194e3177bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.509275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba3a5-e25c-448a-983a-97194e3177bc admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.510815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba3a5-e25c-448a-983a-97194e3177bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.511248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dba3a5-e25c-448a-983a-97194e3177bc admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.512182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba3a5-e25c-448a-983a-97194e3177bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.515613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dba3a5-e25c-448a-983a-97194e3177bc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.542407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:55.581367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 904/1805] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:55 2022] POST /identity/v3/users => generated 311 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:55.586836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba3a5-e25c-448a-983a-97194e3177bc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:55.601003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dba3a5-e25c-448a-983a-97194e3177bc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.607988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb146e98c15448595127881a4d40af9', 'request_id': 'req-079d1eee-0504-41a0-be4f-b20cd26ae0d3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:55.617365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb146e98c15448595127881a4d40af9', 'request_id': 'req-079d1eee-0504-41a0-be4f-b20cd26ae0d3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:55.644038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb146e98c15448595127881a4d40af9', 'request_id': 'req-079d1eee-0504-41a0-be4f-b20cd26ae0d3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:55.694036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] The token cache is being invalidate because project 1eb146e98c15448595127881a4d40af9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:55.694790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:55.699281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-079d1eee-0504-41a0-be4f-b20cd26ae0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:55.706574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 902/1806] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:54 2022] DELETE /identity/v3/projects/1eb146e98c15448595127881a4d40af9 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:55.718845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4c32-27e8-4582-8ef6-16a0a72ac01a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.721545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4c32-27e8-4582-8ef6-16a0a72ac01a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.722588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1b4c32-27e8-4582-8ef6-16a0a72ac01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.761919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.761919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.761919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.761919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.762376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.767574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.807914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 905/1807] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:38:55.807914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:55.811771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:55.821754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1e1b4c32-27e8-4582-8ef6-16a0a72ac01a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:55.826480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1e1b4c32-27e8-4582-8ef6-16a0a72ac01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:55.840729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 903/1808] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:55.851435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e889c-6158-40ad-bfb9-6ca051879343 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.851883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e889c-6158-40ad-bfb9-6ca051879343 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.852095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d9a32-175a-4fde-9ded-500301439575 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:55.854079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e889c-6158-40ad-bfb9-6ca051879343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.880946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc070692-9171-4e7c-a85e-a5e5a61c64de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:55.881669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc070692-9171-4e7c-a85e-a5e5a61c64de admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:55.881973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc070692-9171-4e7c-a85e-a5e5a61c64de admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:55.882303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc070692-9171-4e7c-a85e-a5e5a61c64de admin admin] PATH_INFO: `/v3/projects/0147c4f2780a41c59e691fdc417931be/users/e7d7a6249f3d49f8a4545216a8bc5a12/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:55.924342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc070692-9171-4e7c-a85e-a5e5a61c64de admin admin] RBAC: Authorizing `identity:create_grant(project_id=0147c4f2780a41c59e691fdc417931be, user_id=e7d7a6249f3d49f8a4545216a8bc5a12, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:55.928025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc070692-9171-4e7c-a85e-a5e5a61c64de admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:55.931017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a80e889c-6158-40ad-bfb9-6ca051879343 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:55.934909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a80e889c-6158-40ad-bfb9-6ca051879343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:55.966248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 904/1809] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:55.968538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e889c-6158-40ad-bfb9-6ca051879343 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:55.979926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 906/1810] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:55 2022] PUT /identity/v3/projects/0147c4f2780a41c59e691fdc417931be/users/e7d7a6249f3d49f8a4545216a8bc5a12/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:55.982579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc070692-9171-4e7c-a85e-a5e5a61c64de admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:55.991574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e889c-6158-40ad-bfb9-6ca051879343 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.180043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5870928-19bd-466d-81c0-b5f735bd165c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.180982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870928-19bd-466d-81c0-b5f735bd165c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.184136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870928-19bd-466d-81c0-b5f735bd165c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.185718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5870928-19bd-466d-81c0-b5f735bd165c admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.187243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5870928-19bd-466d-81c0-b5f735bd165c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:56.187775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5870928-19bd-466d-81c0-b5f735bd165c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:56.201965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5870928-19bd-466d-81c0-b5f735bd165c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:56.206496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc070692-9171-4e7c-a85e-a5e5a61c64de admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.231516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 905/1811] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:56.231516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba389c-e6ff-4203-b3e5-32a718ae120d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.231516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba389c-e6ff-4203-b3e5-32a718ae120d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.231516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba389c-e6ff-4203-b3e5-32a718ae120d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.247654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.248720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.250248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.250767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.256341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:56.256538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-31ba389c-e6ff-4203-b3e5-32a718ae120d None None] MFA Rules not processed for user `a0e9262597de4799a64977e44b41e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:56.257667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-31ba389c-e6ff-4203-b3e5-32a718ae120d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:56.262144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:56.262365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:56.326620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 907/1812] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:55 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:38:56.333909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.342778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 906/1813] 10.222.0.79 () {58 vars in 1015 bytes} [Fri Aug 26 00:38:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:56.343735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba389c-e6ff-4203-b3e5-32a718ae120d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.353855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:56.358742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba389c-e6ff-4203-b3e5-32a718ae120d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.370227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe50ee7-1d48-4dbd-b48a-823a64b8d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.370817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d28f0-5e16-484e-af9c-e4c3c2950baa admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.370998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe50ee7-1d48-4dbd-b48a-823a64b8d1ca admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.371294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe50ee7-1d48-4dbd-b48a-823a64b8d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.371569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe50ee7-1d48-4dbd-b48a-823a64b8d1ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.372275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe50ee7-1d48-4dbd-b48a-823a64b8d1ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:56.374688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe50ee7-1d48-4dbd-b48a-823a64b8d1ca admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:56.378053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.378704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.389399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.389819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] PATH_INFO: `/v3/projects/695dc1b1f3e7483fa36868130019d28f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.391679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] RBAC: Authorizing `identity:delete_project(project_id=695dc1b1f3e7483fa36868130019d28f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:56.396440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:56.420132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 907/1814] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:56 2022] POST /identity/v3/projects => generated 377 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:56.421203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe50ee7-1d48-4dbd-b48a-823a64b8d1ca admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.515955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '695dc1b1f3e7483fa36868130019d28f', 'request_id': 'req-927acab5-4aba-42cf-b818-3d05e621079b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:56.528881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '695dc1b1f3e7483fa36868130019d28f', 'request_id': 'req-927acab5-4aba-42cf-b818-3d05e621079b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:56.537557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:56.563390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '695dc1b1f3e7483fa36868130019d28f', 'request_id': 'req-927acab5-4aba-42cf-b818-3d05e621079b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:56.618216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe50ee7-1d48-4dbd-b48a-823a64b8d1ca admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.618843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] The token cache is being invalidate because project 695dc1b1f3e7483fa36868130019d28f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:38:56.625113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:56.627613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:56.636231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 908/1815] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:38:56 2022] DELETE /identity/v3/projects/695dc1b1f3e7483fa36868130019d28f => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:56.636231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.637014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:56.794781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:56.796496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:56.797064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:56.797805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] PATH_INFO: `/v3/projects/0147c4f2780a41c59e691fdc417931be/users/e7d7a6249f3d49f8a4545216a8bc5a12/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:56.800818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0147c4f2780a41c59e691fdc417931be, user_id=e7d7a6249f3d49f8a4545216a8bc5a12, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:56.806786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:56.822814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927acab5-4aba-42cf-b818-3d05e621079b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:56.834472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 908/1816] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:56 2022] PUT /identity/v3/projects/0147c4f2780a41c59e691fdc417931be/users/e7d7a6249f3d49f8a4545216a8bc5a12/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:56.835957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:56.838749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.050432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:57.055292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.057565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.058309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.059176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.076990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.113288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.116748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.154282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 909/1817] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:57.154991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.158510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.187257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca598d5-08db-43ee-8e2d-952336150346 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.187686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1011e2f-0da8-4294-96c3-cdc8c60d371c service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.189150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9559-8711-4e85-adf2-5dcca4cf38c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.191531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9559-8711-4e85-adf2-5dcca4cf38c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.193518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9559-8711-4e85-adf2-5dcca4cf38c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.193960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9559-8711-4e85-adf2-5dcca4cf38c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.194809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9559-8711-4e85-adf2-5dcca4cf38c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.200468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9559-8711-4e85-adf2-5dcca4cf38c9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.215429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd8a20-09dc-4bcb-955d-c88c115b096d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.216186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8a20-09dc-4bcb-955d-c88c115b096d service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.216472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8a20-09dc-4bcb-955d-c88c115b096d service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.216748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd8a20-09dc-4bcb-955d-c88c115b096d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.247995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 909/1818] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:56 2022] POST /identity/v3/users => generated 289 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:57.251009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26375b-9f62-4180-8780-e61680b0e5d9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.251404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26375b-9f62-4180-8780-e61680b0e5d9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.251833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26375b-9f62-4180-8780-e61680b0e5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.254220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd8a20-09dc-4bcb-955d-c88c115b096d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.261779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd8a20-09dc-4bcb-955d-c88c115b096d service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.292586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 910/1819] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:57.295528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cf26375b-9f62-4180-8780-e61680b0e5d9 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:57.296829 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cf26375b-9f62-4180-8780-e61680b0e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.297319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c47f7-ebb2-4911-bc85-7547687d8ba2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.297615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c47f7-ebb2-4911-bc85-7547687d8ba2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.298044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5c47f7-ebb2-4911-bc85-7547687d8ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.315254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 910/1820] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:57.315254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26375b-9f62-4180-8780-e61680b0e5d9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.326003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cf26375b-9f62-4180-8780-e61680b0e5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.399179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26375b-9f62-4180-8780-e61680b0e5d9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.404864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fe5c47f7-ebb2-4911-bc85-7547687d8ba2 None None] MFA Rules not processed for user `e7d7a6249f3d49f8a4545216a8bc5a12`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:57.408694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fe5c47f7-ebb2-4911-bc85-7547687d8ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.415937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.416949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.420324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.420637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] PATH_INFO: `/v3/users/decfc0c3478346e3bf8e2018a739ec55` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.423161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=decfc0c3478346e3bf8e2018a739ec55)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.429699 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.579528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 911/1821] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:57 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:57.580998 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c47f7-ebb2-4911-bc85-7547687d8ba2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.594336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'decfc0c3478346e3bf8e2018a739ec55'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:57.595095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'decfc0c3478346e3bf8e2018a739ec55'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:57.597996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5c47f7-ebb2-4911-bc85-7547687d8ba2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.604749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ab6b1-dc2a-4023-9581-3c4059ec93e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.605996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab6b1-dc2a-4023-9581-3c4059ec93e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.606456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab6b1-dc2a-4023-9581-3c4059ec93e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.606968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ab6b1-dc2a-4023-9581-3c4059ec93e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.608077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab6b1-dc2a-4023-9581-3c4059ec93e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.610303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9ab6b1-dc2a-4023-9581-3c4059ec93e8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:57.614422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'decfc0c3478346e3bf8e2018a739ec55'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:57.634931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'decfc0c3478346e3bf8e2018a739ec55'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:57.637196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 912/1822] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:57.642191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375322a5-6c19-483a-9204-7438812f39c0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.642735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375322a5-6c19-483a-9204-7438812f39c0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.643176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375322a5-6c19-483a-9204-7438812f39c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.664214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:57.675164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-375322a5-6c19-483a-9204-7438812f39c0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:57.677034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-375322a5-6c19-483a-9204-7438812f39c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.699529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'decfc0c3478346e3bf8e2018a739ec55'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:38:57.706237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 913/1823] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:57.709464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 911/1824] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:38:57 2022] DELETE /identity/v3/users/decfc0c3478346e3bf8e2018a739ec55 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:57.710194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375322a5-6c19-483a-9204-7438812f39c0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.710545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:57.712368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.714417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-375322a5-6c19-483a-9204-7438812f39c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:57.922623 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c58ff-18b3-4939-895c-85401ad4dec7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.929058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:57.929968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:57.930338 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:57.931008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:57.931819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375322a5-6c19-483a-9204-7438812f39c0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:57.932088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:57.954349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:58.019328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 912/1825] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:57 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:58.019328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:58.030688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:58.110311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da388fd7-6bae-4f9b-9506-480623817a0e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:58.111399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:58.112119 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.112478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.112824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.123111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:58.140316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615ba87-653e-45f6-91f7-7fe3342dc518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:58.140956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba87-653e-45f6-91f7-7fe3342dc518 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.141245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba87-653e-45f6-91f7-7fe3342dc518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.141533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615ba87-653e-45f6-91f7-7fe3342dc518 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.142342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ba87-653e-45f6-91f7-7fe3342dc518 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:38:58.150045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ba87-653e-45f6-91f7-7fe3342dc518 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:58.152138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615ba87-653e-45f6-91f7-7fe3342dc518 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:58.217314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 913/1826] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:38:58.217314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb3f0-2fd9-49b9-bfd7-a5b0b5fdec23 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.217314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb3f0-2fd9-49b9-bfd7-a5b0b5fdec23 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.217314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb3f0-2fd9-49b9-bfd7-a5b0b5fdec23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.278075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7edfb3f0-2fd9-49b9-bfd7-a5b0b5fdec23 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:58.279435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7edfb3f0-2fd9-49b9-bfd7-a5b0b5fdec23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:58.310826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 914/1827] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:58.311706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfb3f0-2fd9-49b9-bfd7-a5b0b5fdec23 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:58.314954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:58.316578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:58.349596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfb3f0-2fd9-49b9-bfd7-a5b0b5fdec23 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:58.358448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 914/1828] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:57 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:58.359419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:58.375526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf951-77d6-4cc9-9f3a-536b4499c708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:58.376454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf951-77d6-4cc9-9f3a-536b4499c708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.376823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf951-77d6-4cc9-9f3a-536b4499c708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.377143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcf951-77d6-4cc9-9f3a-536b4499c708 admin admin] PATH_INFO: `/v3/projects/223c92029dc7458487586ecfc542b710/users/f6e99b5ff345464faa9634db4389f3f7/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.397408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:58.403093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6067d08-0863-42eb-967a-f6d04870ac35 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:58.415164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:58.415821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.416109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.416369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.417010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:58.419225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:58.471562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcf951-77d6-4cc9-9f3a-536b4499c708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223c92029dc7458487586ecfc542b710, user_id=f6e99b5ff345464faa9634db4389f3f7, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:58.480777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 915/1829] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:58 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:58.483066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:58.489782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:58.497539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fcf951-77d6-4cc9-9f3a-536b4499c708 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:58.625805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 915/1830] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:58 2022] PUT /identity/v3/projects/223c92029dc7458487586ecfc542b710/users/f6e99b5ff345464faa9634db4389f3f7/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:58.627402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf951-77d6-4cc9-9f3a-536b4499c708 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:58.733600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:58.792989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbda065-cae9-476f-a391-a12f7262947f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:58.963443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b36e5c-470d-4858-a0ec-3a4bd8db45e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:58.964087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b36e5c-470d-4858-a0ec-3a4bd8db45e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:58.968210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b36e5c-470d-4858-a0ec-3a4bd8db45e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:58.968495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b36e5c-470d-4858-a0ec-3a4bd8db45e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:58.971739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcf951-77d6-4cc9-9f3a-536b4499c708 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.003770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ace9b7-0c3a-4b5c-bc59-74da3fc7ae2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.004406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ace9b7-0c3a-4b5c-bc59-74da3fc7ae2a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.004716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ace9b7-0c3a-4b5c-bc59-74da3fc7ae2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.005157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ace9b7-0c3a-4b5c-bc59-74da3fc7ae2a admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.005645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ace9b7-0c3a-4b5c-bc59-74da3fc7ae2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.007647 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ace9b7-0c3a-4b5c-bc59-74da3fc7ae2a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.013400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b36e5c-470d-4858-a0ec-3a4bd8db45e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.014889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b36e5c-470d-4858-a0ec-3a4bd8db45e4 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.055901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 916/1831] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:59.058565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19313-90c0-4019-86c2-334e15340cde None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.058857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19313-90c0-4019-86c2-334e15340cde None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.059139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f19313-90c0-4019-86c2-334e15340cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.084814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 916/1832] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:58 2022] POST /identity/v3/users => generated 301 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:59.086547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ace9b7-0c3a-4b5c-bc59-74da3fc7ae2a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.111478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ace9b7-0c3a-4b5c-bc59-74da3fc7ae2a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.132259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.132801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.133087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.133370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.134059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.139794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.156907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f3f19313-90c0-4019-86c2-334e15340cde None None] MFA Rules not processed for user `f6e99b5ff345464faa9634db4389f3f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:38:59.158268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f3f19313-90c0-4019-86c2-334e15340cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:59.174482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 917/1833] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:59.175378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.185955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:59.402200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 917/1834] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:38:59.403169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19313-90c0-4019-86c2-334e15340cde None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.404749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612246b9-fb0e-49ff-9752-6a9629dfc74a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.428449 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.429079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.429365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.429630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.438980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:38:59.443465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f19313-90c0-4019-86c2-334e15340cde None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.459589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39d44-99c7-477f-88c2-5f0959317b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.460224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39d44-99c7-477f-88c2-5f0959317b31 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.460686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39d44-99c7-477f-88c2-5f0959317b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.460781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39d44-99c7-477f-88c2-5f0959317b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.461416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a39d44-99c7-477f-88c2-5f0959317b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.468908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a39d44-99c7-477f-88c2-5f0959317b31 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.503051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 918/1835] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:38:59.504476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39d44-99c7-477f-88c2-5f0959317b31 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.525000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39d44-99c7-477f-88c2-5f0959317b31 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.538630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c13ebc-8be7-4d0f-bb25-db9f628669b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.539263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c13ebc-8be7-4d0f-bb25-db9f628669b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.539546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c13ebc-8be7-4d0f-bb25-db9f628669b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.539823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c13ebc-8be7-4d0f-bb25-db9f628669b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.540468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c13ebc-8be7-4d0f-bb25-db9f628669b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.542424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c13ebc-8be7-4d0f-bb25-db9f628669b7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.585370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.589088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.618848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 918/1836] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:38:59 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:38:59.619954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.648032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e12fbf-0f23-46cc-9d4f-2d5fe3ba5d72 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.652868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 919/1837] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:38:59 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:38:59.658006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c13ebc-8be7-4d0f-bb25-db9f628669b7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:38:59.672409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:59.805102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d938c-2157-4852-9b91-2e8ac4079f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.807314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d938c-2157-4852-9b91-2e8ac4079f96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.808622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d938c-2157-4852-9b91-2e8ac4079f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.809486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d938c-2157-4852-9b91-2e8ac4079f96 admin admin] PATH_INFO: `/v3/projects/98581d0321b94e37b3a795f241fb0813/users/b477bea4ff924ca9960ff16e641aa3e6/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.878195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d938c-2157-4852-9b91-2e8ac4079f96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98581d0321b94e37b3a795f241fb0813, user_id=b477bea4ff924ca9960ff16e641aa3e6, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.890907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c13ebc-8be7-4d0f-bb25-db9f628669b7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:38:59.896003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d938c-2157-4852-9b91-2e8ac4079f96 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.907307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61a8cc-3883-4f55-b6a9-bba8ca4e51d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:38:59.908646 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61a8cc-3883-4f55-b6a9-bba8ca4e51d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.915173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61a8cc-3883-4f55-b6a9-bba8ca4e51d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.916751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d61a8cc-3883-4f55-b6a9-bba8ca4e51d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.919714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61a8cc-3883-4f55-b6a9-bba8ca4e51d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:38:59.922837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d61a8cc-3883-4f55-b6a9-bba8ca4e51d3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:38:59.954101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:38:59.959588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 919/1838] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:38:59 2022] PUT /identity/v3/projects/98581d0321b94e37b3a795f241fb0813/users/b477bea4ff924ca9960ff16e641aa3e6/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:38:59.964724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898adec8-1806-4aa7-a9e0-679ccbd0a012 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.965055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898adec8-1806-4aa7-a9e0-679ccbd0a012 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.966363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898adec8-1806-4aa7-a9e0-679ccbd0a012 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:38:59.972845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 920/1839] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:38:59 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:38:59.976525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f527-743c-4f28-9df1-a1f99bed3081 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:38:59.978107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f527-743c-4f28-9df1-a1f99bed3081 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:38:59.978107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f527-743c-4f28-9df1-a1f99bed3081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.008756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 920/1840] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:38:59 2022] POST /identity/v3/users => generated 295 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:00.017392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61a8cc-3883-4f55-b6a9-bba8ca4e51d3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.076285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d61a8cc-3883-4f55-b6a9-bba8ca4e51d3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.094928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2221f527-743c-4f28-9df1-a1f99bed3081 None None] MFA Rules not processed for user `b477bea4ff924ca9960ff16e641aa3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:00.105086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2221f527-743c-4f28-9df1-a1f99bed3081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:00.289773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 921/1841] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:38:59 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:00.291225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b6d9-bc65-461b-b4f0-d5c97d434b2c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.291513 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b6d9-bc65-461b-b4f0-d5c97d434b2c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.299950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0729b6d9-bc65-461b-b4f0-d5c97d434b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.309580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227d2c4-6444-4785-99de-d321185ebbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.310617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d2c4-6444-4785-99de-d321185ebbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.311125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d2c4-6444-4785-99de-d321185ebbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.311605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9227d2c4-6444-4785-99de-d321185ebbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.312542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227d2c4-6444-4785-99de-d321185ebbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.314946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9227d2c4-6444-4785-99de-d321185ebbd5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.337344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 921/1842] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:00.338549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227d2c4-6444-4785-99de-d321185ebbd5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.367884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9227d2c4-6444-4785-99de-d321185ebbd5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.386982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31de4df-c3b5-4f3c-aff9-e9b90c434d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.388364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31de4df-c3b5-4f3c-aff9-e9b90c434d52 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.388857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31de4df-c3b5-4f3c-aff9-e9b90c434d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.389395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31de4df-c3b5-4f3c-aff9-e9b90c434d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.390342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31de4df-c3b5-4f3c-aff9-e9b90c434d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.392558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31de4df-c3b5-4f3c-aff9-e9b90c434d52 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.396988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0729b6d9-bc65-461b-b4f0-d5c97d434b2c None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:00.398253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0729b6d9-bc65-461b-b4f0-d5c97d434b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:00.476332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 922/1843] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:00 2022] POST /identity/v3/projects => generated 401 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:00.478144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31de4df-c3b5-4f3c-aff9-e9b90c434d52 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.597226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 922/1844] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:39:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:00.597612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729b6d9-bc65-461b-b4f0-d5c97d434b2c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.637225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0729b6d9-bc65-461b-b4f0-d5c97d434b2c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.671212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31de4df-c3b5-4f3c-aff9-e9b90c434d52 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.678576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:00.695502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.698612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.699039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.701844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] PATH_INFO: `/v3/projects/59971780246c45e49bbe4b23c5cda9bb/users/3c72e8ae61c54c6787318ddb92aec808/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.763620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59971780246c45e49bbe4b23c5cda9bb, user_id=3c72e8ae61c54c6787318ddb92aec808, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.772482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.825266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 923/1845] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:00 2022] PUT /identity/v3/projects/59971780246c45e49bbe4b23c5cda9bb/users/3c72e8ae61c54c6787318ddb92aec808/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:00.825772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.826460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944cfec-7a0f-4996-af79-969478d17f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:00.828103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944cfec-7a0f-4996-af79-969478d17f1d admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:00.828552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944cfec-7a0f-4996-af79-969478d17f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:00.828963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944cfec-7a0f-4996-af79-969478d17f1d admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:00.829849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944cfec-7a0f-4996-af79-969478d17f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:00.831498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:00.834597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944cfec-7a0f-4996-af79-969478d17f1d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:00.890905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 923/1846] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:00 2022] POST /identity/v3/users => generated 307 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:00.899488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944cfec-7a0f-4996-af79-969478d17f1d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:00.921599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944cfec-7a0f-4996-af79-969478d17f1d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:00.993618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:01.055542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80671-8558-4aa2-8391-c5f4b2f5cb79 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.072177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2c5e2-7458-4893-a04a-789c1035d0a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.073217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2c5e2-7458-4893-a04a-789c1035d0a9 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.073739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2c5e2-7458-4893-a04a-789c1035d0a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.074172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c2c5e2-7458-4893-a04a-789c1035d0a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.096070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2c5e2-7458-4893-a04a-789c1035d0a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.098557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c2c5e2-7458-4893-a04a-789c1035d0a9 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.108590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd836e79-01f5-4ea0-8ff4-75140541c691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.110053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd836e79-01f5-4ea0-8ff4-75140541c691 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.110494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd836e79-01f5-4ea0-8ff4-75140541c691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.110930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd836e79-01f5-4ea0-8ff4-75140541c691 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.112802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd836e79-01f5-4ea0-8ff4-75140541c691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.117066 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd836e79-01f5-4ea0-8ff4-75140541c691 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.127123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 924/1847] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:01.128378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2c5e2-7458-4893-a04a-789c1035d0a9 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.135737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 924/1848] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:01.139575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd836e79-01f5-4ea0-8ff4-75140541c691 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.163391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c2c5e2-7458-4893-a04a-789c1035d0a9 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.173975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f9bb-2621-4078-91bd-09f3955341e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.175742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f9bb-2621-4078-91bd-09f3955341e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.176154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f9bb-2621-4078-91bd-09f3955341e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.177222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05f9bb-2621-4078-91bd-09f3955341e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.178240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05f9bb-2621-4078-91bd-09f3955341e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.180654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd836e79-01f5-4ea0-8ff4-75140541c691 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.180981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05f9bb-2621-4078-91bd-09f3955341e9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.201362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 925/1849] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:01.205142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f9bb-2621-4078-91bd-09f3955341e9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.214662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b367ed-4dfe-458d-acb1-2b0d9bc5290b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.215358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b367ed-4dfe-458d-acb1-2b0d9bc5290b admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.215639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b367ed-4dfe-458d-acb1-2b0d9bc5290b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.215912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b367ed-4dfe-458d-acb1-2b0d9bc5290b admin admin] PATH_INFO: `/v3/projects/59971780246c45e49bbe4b23c5cda9bb/users/3c72e8ae61c54c6787318ddb92aec808/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.220345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b367ed-4dfe-458d-acb1-2b0d9bc5290b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59971780246c45e49bbe4b23c5cda9bb, user_id=3c72e8ae61c54c6787318ddb92aec808, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.224534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b367ed-4dfe-458d-acb1-2b0d9bc5290b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.226180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05f9bb-2621-4078-91bd-09f3955341e9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.241570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67455ed6-464c-4fea-bb21-cd3776ca51aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.242389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67455ed6-464c-4fea-bb21-cd3776ca51aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.243207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67455ed6-464c-4fea-bb21-cd3776ca51aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.243604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67455ed6-464c-4fea-bb21-cd3776ca51aa admin admin] PATH_INFO: `/v3/projects/a798a16f8db34e44a30810ef37fee1d2/users/06514a9c6e8a45f399ce48fe31301f3f/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.273394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 925/1850] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:01 2022] PUT /identity/v3/projects/59971780246c45e49bbe4b23c5cda9bb/users/3c72e8ae61c54c6787318ddb92aec808/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:01.279463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67455ed6-464c-4fea-bb21-cd3776ca51aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a798a16f8db34e44a30810ef37fee1d2, user_id=06514a9c6e8a45f399ce48fe31301f3f, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.282823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67455ed6-464c-4fea-bb21-cd3776ca51aa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.284217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebaa2a-472c-4201-83c8-06a00d55350a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.284824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebaa2a-472c-4201-83c8-06a00d55350a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.285270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebaa2a-472c-4201-83c8-06a00d55350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.312438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 926/1851] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:01 2022] PUT /identity/v3/projects/a798a16f8db34e44a30810ef37fee1d2/users/06514a9c6e8a45f399ce48fe31301f3f/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:01.316675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67455ed6-464c-4fea-bb21-cd3776ca51aa admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.357580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b8ebaa2a-472c-4201-83c8-06a00d55350a None None] MFA Rules not processed for user `3c72e8ae61c54c6787318ddb92aec808`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:01.360360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b8ebaa2a-472c-4201-83c8-06a00d55350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:01.455835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67455ed6-464c-4fea-bb21-cd3776ca51aa admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.467335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.469180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.470181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.470677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.473705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.480973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.511320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 926/1852] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:01.523377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebaa2a-472c-4201-83c8-06a00d55350a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.530118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 927/1853] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:01.531238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:01.535563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:01.537210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebaa2a-472c-4201-83c8-06a00d55350a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.549192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818766f7-5cec-4532-bad4-6660730ab7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.549947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818766f7-5cec-4532-bad4-6660730ab7cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.550237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818766f7-5cec-4532-bad4-6660730ab7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.550509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818766f7-5cec-4532-bad4-6660730ab7cf admin admin] PATH_INFO: `/v3/projects/a798a16f8db34e44a30810ef37fee1d2/users/06514a9c6e8a45f399ce48fe31301f3f/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.555203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818766f7-5cec-4532-bad4-6660730ab7cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a798a16f8db34e44a30810ef37fee1d2, user_id=06514a9c6e8a45f399ce48fe31301f3f, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.558159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818766f7-5cec-4532-bad4-6660730ab7cf admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.607598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 927/1854] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:01 2022] PUT /identity/v3/projects/a798a16f8db34e44a30810ef37fee1d2/users/06514a9c6e8a45f399ce48fe31301f3f/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:01.611897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df36c-67b4-4cb4-94b9-a780831f568a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.612870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df36c-67b4-4cb4-94b9-a780831f568a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.613139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8df36c-67b4-4cb4-94b9-a780831f568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.646565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:01.679631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-aa8df36c-67b4-4cb4-94b9-a780831f568a None None] MFA Rules not processed for user `06514a9c6e8a45f399ce48fe31301f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:01.680864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-aa8df36c-67b4-4cb4-94b9-a780831f568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:01.694209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a125ce-601c-453e-960a-968fd70f4c3c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:01.810504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:01.820774 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2091c7-1b2f-4f63-a084-a305e99f5f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:01.821414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2091c7-1b2f-4f63-a084-a305e99f5f28 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.821698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2091c7-1b2f-4f63-a084-a305e99f5f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.822053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2091c7-1b2f-4f63-a084-a305e99f5f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.944812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 928/1855] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:01 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:01.945694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca397e-76d9-45f9-801d-adfb584ffa67 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.947298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca397e-76d9-45f9-801d-adfb584ffa67 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.947627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca397e-76d9-45f9-801d-adfb584ffa67 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:01.949961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 929/1856] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:39:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:01.974278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2091c7-1b2f-4f63-a084-a305e99f5f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:01.976987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2091c7-1b2f-4f63-a084-a305e99f5f28 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:01.989205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608a29-c142-487e-9333-0d7f2f6bf793 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:01.990257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608a29-c142-487e-9333-0d7f2f6bf793 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:01.990921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27608a29-c142-487e-9333-0d7f2f6bf793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:02.032974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 928/1857] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:01 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:02.124049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-27608a29-c142-487e-9333-0d7f2f6bf793 None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:02.127577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-27608a29-c142-487e-9333-0d7f2f6bf793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:02.234906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2091c7-1b2f-4f63-a084-a305e99f5f28 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:02.257620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2091c7-1b2f-4f63-a084-a305e99f5f28 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:02.283577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e428da-b2f1-4bb9-9435-7dfc4665b156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:02.284218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e428da-b2f1-4bb9-9435-7dfc4665b156 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:02.284601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e428da-b2f1-4bb9-9435-7dfc4665b156 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:02.284781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e428da-b2f1-4bb9-9435-7dfc4665b156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:02.327413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e428da-b2f1-4bb9-9435-7dfc4665b156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:02.334878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e428da-b2f1-4bb9-9435-7dfc4665b156 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:02.358648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 929/1858] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:02 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:02.406031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 930/1859] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:39:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:02.641031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e428da-b2f1-4bb9-9435-7dfc4665b156 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:02.668729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e428da-b2f1-4bb9-9435-7dfc4665b156 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:02.703959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb417-3dd6-4432-bc55-bbbfcaac9b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:02.704693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb417-3dd6-4432-bc55-bbbfcaac9b63 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:02.707487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb417-3dd6-4432-bc55-bbbfcaac9b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:02.708656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1eb417-3dd6-4432-bc55-bbbfcaac9b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:02.763293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608a29-c142-487e-9333-0d7f2f6bf793 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:02.765407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-27608a29-c142-487e-9333-0d7f2f6bf793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:02.809329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27608a29-c142-487e-9333-0d7f2f6bf793 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:02.835219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:02.836359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:02.836649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:02.836936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:02.868112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:02.869754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:02.889821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eb417-3dd6-4432-bc55-bbbfcaac9b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:02.903080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1eb417-3dd6-4432-bc55-bbbfcaac9b63 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:02.909965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 931/1860] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:02.941200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 930/1861] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:02 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:03.870546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:03.872140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:04.188997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99d63e-490e-43b5-bd98-969cc6a93421 service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:04.210047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:04.212364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:04.216606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:04.217128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] PATH_INFO: `/v3/projects/63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:04.219433 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] RBAC: Authorizing `identity:delete_project(project_id=63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:04.236517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:04.299581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:04.383181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4', 'request_id': 'req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.394379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4', 'request_id': 'req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.413416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4', 'request_id': 'req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.445133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] The token cache is being invalidate because project 63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:04.445442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.446929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.452097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 932/1862] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:03 2022] DELETE /identity/v3/projects/63f4df7a8c6c4ea7bfbf8d5bf4cd9dd4 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:04.460180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb417-3dd6-4432-bc55-bbbfcaac9b63 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:04.474905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1eb417-3dd6-4432-bc55-bbbfcaac9b63 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:04.649209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:04.650187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:04.651084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:04.652615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] PATH_INFO: `/v3/users/37032c0ba05d4d65ab88468f6f3c4c4d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:04.656000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37032c0ba05d4d65ab88468f6f3c4c4d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:04.658404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:04.741378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:04.775571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37032c0ba05d4d65ab88468f6f3c4c4d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.810167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37032c0ba05d4d65ab88468f6f3c4c4d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.811037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37032c0ba05d4d65ab88468f6f3c4c4d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.832455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37032c0ba05d4d65ab88468f6f3c4c4d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.875956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37032c0ba05d4d65ab88468f6f3c4c4d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:04.910256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 931/1863] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:04 2022] DELETE /identity/v3/users/37032c0ba05d4d65ab88468f6f3c4c4d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:05.451214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.456052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:05.492844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ddb3d-9cee-4b8f-b2ea-be639dadbfef admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.584730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:05.586378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:05.639703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.642084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.643258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.643571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] PATH_INFO: `/v3/projects/2d7caf500b4b47369d6a5d569c7a9c14` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.648260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d7caf500b4b47369d6a5d569c7a9c14)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:05.652046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:05.745778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267785e-3ccd-4eab-be3d-03f26b4a7b06 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:05.763881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a7231-3adc-4496-b701-ed739f64d2c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:05.766991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a7231-3adc-4496-b701-ed739f64d2c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.768759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a7231-3adc-4496-b701-ed739f64d2c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.770150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a7231-3adc-4496-b701-ed739f64d2c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.779587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f71a7231-3adc-4496-b701-ed739f64d2c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:05.849699 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d7caf500b4b47369d6a5d569c7a9c14', 'request_id': 'req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:05.871051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d7caf500b4b47369d6a5d569c7a9c14', 'request_id': 'req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:05.904810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d7caf500b4b47369d6a5d569c7a9c14', 'request_id': 'req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:05.925716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a7231-3adc-4496-b701-ed739f64d2c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:05.928306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a7231-3adc-4496-b701-ed739f64d2c0 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:05.933111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] The token cache is being invalidate because project 2d7caf500b4b47369d6a5d569c7a9c14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:05.935410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:05.937449 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-87f21286-b8f4-4e71-a1d2-1a5c3c3152fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:05.946812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 933/1864] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:05 2022] DELETE /identity/v3/projects/2d7caf500b4b47369d6a5d569c7a9c14 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:05.949653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886bfe1-b0bc-436c-8803-d86ffe112d7c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:05.949653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886bfe1-b0bc-436c-8803-d86ffe112d7c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:05.950030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886bfe1-b0bc-436c-8803-d86ffe112d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:05.962308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 932/1865] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:06.048952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4886bfe1-b0bc-436c-8803-d86ffe112d7c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:06.051244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4886bfe1-b0bc-436c-8803-d86ffe112d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:06.138028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:06.192062 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 934/1866] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:06.202139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0e55-038a-4e9d-8c6c-9dba4a12e72f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.202560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0e55-038a-4e9d-8c6c-9dba4a12e72f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.202902 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff0e55-038a-4e9d-8c6c-9dba4a12e72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.266919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b8ff0e55-038a-4e9d-8c6c-9dba4a12e72f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:06.271885 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b8ff0e55-038a-4e9d-8c6c-9dba4a12e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:06.299648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 933/1867] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:06.305008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886bfe1-b0bc-436c-8803-d86ffe112d7c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.317562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886bfe1-b0bc-436c-8803-d86ffe112d7c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.324594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.325574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.326037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.326633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.327684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:06.328233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.330886 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.355752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 935/1868] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:06.360659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0e55-038a-4e9d-8c6c-9dba4a12e72f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.372400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ff0e55-038a-4e9d-8c6c-9dba4a12e72f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.387179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bc314-e225-4efa-a421-449e671f2f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.387942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bc314-e225-4efa-a421-449e671f2f00 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.388292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bc314-e225-4efa-a421-449e671f2f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.390488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589bc314-e225-4efa-a421-449e671f2f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.391102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bc314-e225-4efa-a421-449e671f2f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.393008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589bc314-e225-4efa-a421-449e671f2f00 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.458930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 934/1869] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:06 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:06.463303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.490892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6b1ca-db2d-4b94-a57a-3a05dcab31f7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.594159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d83af-79d3-47b3-ae73-89705407aee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.594849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d83af-79d3-47b3-ae73-89705407aee6 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.595140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d83af-79d3-47b3-ae73-89705407aee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.595411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d83af-79d3-47b3-ae73-89705407aee6 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.596086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d83af-79d3-47b3-ae73-89705407aee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.598249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d83af-79d3-47b3-ae73-89705407aee6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.657992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 936/1870] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:06 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:06.662772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bc314-e225-4efa-a421-449e671f2f00 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.679802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589bc314-e225-4efa-a421-449e671f2f00 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.686789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc1917-1dc1-461b-b91a-0f7f4854c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.689495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc1917-1dc1-461b-b91a-0f7f4854c3c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.690120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc1917-1dc1-461b-b91a-0f7f4854c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.690640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dc1917-1dc1-461b-b91a-0f7f4854c3c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.692624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc1917-1dc1-461b-b91a-0f7f4854c3c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.700256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dc1917-1dc1-461b-b91a-0f7f4854c3c6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.714463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 935/1871] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:06.718261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d83af-79d3-47b3-ae73-89705407aee6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.732296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d83af-79d3-47b3-ae73-89705407aee6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.740437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23f0f6-96bd-4ad7-8817-862bab2ead7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.741307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f0f6-96bd-4ad7-8817-862bab2ead7d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.742423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f0f6-96bd-4ad7-8817-862bab2ead7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.742870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23f0f6-96bd-4ad7-8817-862bab2ead7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.743693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23f0f6-96bd-4ad7-8817-862bab2ead7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.746023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23f0f6-96bd-4ad7-8817-862bab2ead7d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.758119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 937/1872] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:06.763863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc1917-1dc1-461b-b91a-0f7f4854c3c6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:06.777152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dc1917-1dc1-461b-b91a-0f7f4854c3c6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:06.783877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3a94-8da8-4551-b26d-fafde60e88c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:06.784777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3a94-8da8-4551-b26d-fafde60e88c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.785229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3a94-8da8-4551-b26d-fafde60e88c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.786296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f3a94-8da8-4551-b26d-fafde60e88c4 admin admin] PATH_INFO: `/v3/projects/250d940208a449608fbcd6f3c41caf1e/users/11e64d10748f494693401e2aab9fea96/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.813136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f3a94-8da8-4551-b26d-fafde60e88c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=250d940208a449608fbcd6f3c41caf1e, user_id=11e64d10748f494693401e2aab9fea96, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:06.830478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f3a94-8da8-4551-b26d-fafde60e88c4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:06.839951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:06.863011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 936/1873] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:06 2022] PUT /identity/v3/projects/250d940208a449608fbcd6f3c41caf1e/users/11e64d10748f494693401e2aab9fea96/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:06.875096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdeebf-a111-429a-987d-a9632431c14e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:06.875675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdeebf-a111-429a-987d-a9632431c14e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:06.876105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afdeebf-a111-429a-987d-a9632431c14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:06.923345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9afdeebf-a111-429a-987d-a9632431c14e None None] MFA Rules not processed for user `11e64d10748f494693401e2aab9fea96`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:06.927533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9afdeebf-a111-429a-987d-a9632431c14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:07.027838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 938/1874] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:07.032465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3a94-8da8-4551-b26d-fafde60e88c4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.103174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f3a94-8da8-4551-b26d-fafde60e88c4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.107769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb4eb-e2a1-4981-a3eb-1b07c3c848c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.108371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb4eb-e2a1-4981-a3eb-1b07c3c848c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.108656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb4eb-e2a1-4981-a3eb-1b07c3c848c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.108925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cb4eb-e2a1-4981-a3eb-1b07c3c848c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.109599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cb4eb-e2a1-4981-a3eb-1b07c3c848c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.111606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cb4eb-e2a1-4981-a3eb-1b07c3c848c2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.140976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 937/1875] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:07 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:07.145924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdeebf-a111-429a-987d-a9632431c14e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.157037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afdeebf-a111-429a-987d-a9632431c14e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.185006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:07.229492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffcbec-94f4-4491-9e85-fafa855890a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.230620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcbec-94f4-4491-9e85-fafa855890a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.231115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcbec-94f4-4491-9e85-fafa855890a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.231617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffcbec-94f4-4491-9e85-fafa855890a1 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.232759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffcbec-94f4-4491-9e85-fafa855890a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.236744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffcbec-94f4-4491-9e85-fafa855890a1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.269552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 939/1876] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:07 2022] POST /identity/v3/users => generated 300 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:07.271677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb4eb-e2a1-4981-a3eb-1b07c3c848c2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.281981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cb4eb-e2a1-4981-a3eb-1b07c3c848c2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.286745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258b404-45c9-4920-881e-809135c1c64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.287351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258b404-45c9-4920-881e-809135c1c64c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.287636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258b404-45c9-4920-881e-809135c1c64c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.287914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258b404-45c9-4920-881e-809135c1c64c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.288567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258b404-45c9-4920-881e-809135c1c64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.290214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258b404-45c9-4920-881e-809135c1c64c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.304663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 938/1877] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:07.306084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffcbec-94f4-4491-9e85-fafa855890a1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.316735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffcbec-94f4-4491-9e85-fafa855890a1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.322005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d34f5-8aeb-468b-8e64-99a9bcfbf54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.322606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d34f5-8aeb-468b-8e64-99a9bcfbf54f admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.322920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d34f5-8aeb-468b-8e64-99a9bcfbf54f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.323194 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d34f5-8aeb-468b-8e64-99a9bcfbf54f admin admin] PATH_INFO: `/v3/projects/4fa80efa630c4ffa9846d5e4eba36a87/users/d334d6fa80ef4c5ead65cf389396e64d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.338776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d34f5-8aeb-468b-8e64-99a9bcfbf54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa80efa630c4ffa9846d5e4eba36a87, user_id=d334d6fa80ef4c5ead65cf389396e64d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.341466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d34f5-8aeb-468b-8e64-99a9bcfbf54f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.360858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 940/1878] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:07 2022] PUT /identity/v3/projects/4fa80efa630c4ffa9846d5e4eba36a87/users/d334d6fa80ef4c5ead65cf389396e64d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:07.365312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258b404-45c9-4920-881e-809135c1c64c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.380398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258b404-45c9-4920-881e-809135c1c64c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.445827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fce48a1-a598-4da3-bc76-478d593b680d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.446531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce48a1-a598-4da3-bc76-478d593b680d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.446813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce48a1-a598-4da3-bc76-478d593b680d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.447089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fce48a1-a598-4da3-bc76-478d593b680d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.447801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce48a1-a598-4da3-bc76-478d593b680d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.449461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fce48a1-a598-4da3-bc76-478d593b680d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.465210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 939/1879] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:07.469924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d34f5-8aeb-468b-8e64-99a9bcfbf54f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.484695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d34f5-8aeb-468b-8e64-99a9bcfbf54f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.491179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.492032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.492323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.492612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] PATH_INFO: `/v3/projects/4fa80efa630c4ffa9846d5e4eba36a87/users/d334d6fa80ef4c5ead65cf389396e64d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.494950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa80efa630c4ffa9846d5e4eba36a87, user_id=d334d6fa80ef4c5ead65cf389396e64d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.498118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.511430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 941/1880] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:07 2022] PUT /identity/v3/projects/4fa80efa630c4ffa9846d5e4eba36a87/users/d334d6fa80ef4c5ead65cf389396e64d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:07.523938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d0f5-a3b5-462f-9084-ed1c6939a624 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.524537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d0f5-a3b5-462f-9084-ed1c6939a624 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.524984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4d0f5-a3b5-462f-9084-ed1c6939a624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.562868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-34e4d0f5-a3b5-462f-9084-ed1c6939a624 None None] MFA Rules not processed for user `d334d6fa80ef4c5ead65cf389396e64d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:07.564097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-34e4d0f5-a3b5-462f-9084-ed1c6939a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:07.580868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.583374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:07.660753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:07.664632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd3fc00-ff7a-4230-acd5-451c157dface admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.670902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.671672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.672057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.672566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] PATH_INFO: `/v3/users/4383349cfea040169ee36d46186190f6` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.674429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4383349cfea040169ee36d46186190f6)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:07.678162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:07.697042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 940/1881] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:07 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:07.706172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4d0f5-a3b5-462f-9084-ed1c6939a624 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.708644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-34e4d0f5-a3b5-462f-9084-ed1c6939a624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:07.735351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4383349cfea040169ee36d46186190f6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:07.736859 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4383349cfea040169ee36d46186190f6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:07.753532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4383349cfea040169ee36d46186190f6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:07.773070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4383349cfea040169ee36d46186190f6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:07.789792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-763e377a-367d-4cc6-a3fc-94354a8a9f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4383349cfea040169ee36d46186190f6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:07.791753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:07.805061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 942/1882] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:07 2022] DELETE /identity/v3/users/4383349cfea040169ee36d46186190f6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:07.806945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb353-3e0a-44ee-bc26-eb0e774316c1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.807833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb353-3e0a-44ee-bc26-eb0e774316c1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.808462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7eb353-3e0a-44ee-bc26-eb0e774316c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.818161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4d0f5-a3b5-462f-9084-ed1c6939a624 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:07.838836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bf7eb353-3e0a-44ee-bc26-eb0e774316c1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:07.840291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bf7eb353-3e0a-44ee-bc26-eb0e774316c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:07.913303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:07.914063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:07.914405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:07.914758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:07.918521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:07.936815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 943/1883] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:07.948825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eb353-3e0a-44ee-bc26-eb0e774316c1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:07.950878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bf7eb353-3e0a-44ee-bc26-eb0e774316c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:08.027646 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.029380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.032650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7eb353-3e0a-44ee-bc26-eb0e774316c1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.039789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.040769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.041344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.041726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.045183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 941/1884] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:08.056901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.058945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.072247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 944/1885] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:08.638145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.639988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:08.648914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.652572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:08.659204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65658f6e-b39a-4e8a-9843-c8916478bf7e service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.667370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.668299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.668952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.669331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] PATH_INFO: `/v3/users/b477bea4ff924ca9960ff16e641aa3e6` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.671110 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b477bea4ff924ca9960ff16e641aa3e6)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.674260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.681173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3091adec-fe28-44b6-9238-c144c0a5a30c service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.686272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.686865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.687174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.687423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] PATH_INFO: `/v3/projects/bac1af53228c47968848a02f73f31829` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.688660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac1af53228c47968848a02f73f31829)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.692723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.746063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b477bea4ff924ca9960ff16e641aa3e6'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.749677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:08.770142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac1af53228c47968848a02f73f31829', 'request_id': 'req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.771510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b477bea4ff924ca9960ff16e641aa3e6'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.771958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b477bea4ff924ca9960ff16e641aa3e6'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.780142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac1af53228c47968848a02f73f31829', 'request_id': 'req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.781674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b477bea4ff924ca9960ff16e641aa3e6'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.791458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b4645bc9-ba94-4f81-87e8-83ac42632ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b477bea4ff924ca9960ff16e641aa3e6'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.793153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac1af53228c47968848a02f73f31829', 'request_id': 'req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.803429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 942/1886] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:08 2022] DELETE /identity/v3/users/b477bea4ff924ca9960ff16e641aa3e6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:08.808331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cbea5-fef8-48ec-b7ee-301e68722a5b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.808901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cbea5-fef8-48ec-b7ee-301e68722a5b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.809450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cbea5-fef8-48ec-b7ee-301e68722a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.811472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] The token cache is being invalidate because project bac1af53228c47968848a02f73f31829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:08.811881 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.812697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:08.814849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 945/1887] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:08 2022] DELETE /identity/v3/projects/bac1af53228c47968848a02f73f31829 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:08.820091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.822156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:08.839925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d88cbea5-fef8-48ec-b7ee-301e68722a5b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:08.841087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d88cbea5-fef8-48ec-b7ee-301e68722a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:08.870985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:08.928443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 943/1888] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:08.928928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a5e51e-a9d2-45e3-8d2d-2d35b7cd61ff admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:08.940909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:08.941658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:08.942713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:08.943317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] PATH_INFO: `/v3/users/e7d7a6249f3d49f8a4545216a8bc5a12` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:08.944861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7d7a6249f3d49f8a4545216a8bc5a12)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:08.944975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cbea5-fef8-48ec-b7ee-301e68722a5b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:08.947212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:08.953447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d88cbea5-fef8-48ec-b7ee-301e68722a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.040977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7d7a6249f3d49f8a4545216a8bc5a12'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.041912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7d7a6249f3d49f8a4545216a8bc5a12'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.053660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7d7a6249f3d49f8a4545216a8bc5a12'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.064491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7d7a6249f3d49f8a4545216a8bc5a12'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.079169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cbea5-fef8-48ec-b7ee-301e68722a5b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.080046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7d7a6249f3d49f8a4545216a8bc5a12'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.083559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3398c158-f954-4241-b0a1-2b26e2481177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.084210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398c158-f954-4241-b0a1-2b26e2481177 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.084492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398c158-f954-4241-b0a1-2b26e2481177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.084772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3398c158-f954-4241-b0a1-2b26e2481177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.086561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3398c158-f954-4241-b0a1-2b26e2481177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.090029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 946/1889] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:08 2022] DELETE /identity/v3/users/e7d7a6249f3d49f8a4545216a8bc5a12 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:09.090029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.091724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.100905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398c158-f954-4241-b0a1-2b26e2481177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.102387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3398c158-f954-4241-b0a1-2b26e2481177 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.113189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 944/1890] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:09.169441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd0e9d9-aebb-40bb-a45c-e937405426a0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.174691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.175464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.175853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.176763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] PATH_INFO: `/v3/users/11e64d10748f494693401e2aab9fea96` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.178383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e64d10748f494693401e2aab9fea96)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.180123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.241302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:09.244885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e64d10748f494693401e2aab9fea96'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.245702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e64d10748f494693401e2aab9fea96'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.257855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e64d10748f494693401e2aab9fea96'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.269455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e64d10748f494693401e2aab9fea96'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.290883 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e64d10748f494693401e2aab9fea96'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.297824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 947/1891] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:09 2022] DELETE /identity/v3/users/11e64d10748f494693401e2aab9fea96 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:09.302892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b554-6a9d-447a-a72f-36a37ba92cb3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.303192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b554-6a9d-447a-a72f-36a37ba92cb3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.303469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d58b554-6a9d-447a-a72f-36a37ba92cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.322918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6d58b554-6a9d-447a-a72f-36a37ba92cb3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:09.324150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6d58b554-6a9d-447a-a72f-36a37ba92cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.443916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 945/1892] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:09.483425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.485791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.620399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58b554-6a9d-447a-a72f-36a37ba92cb3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.622066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6d58b554-6a9d-447a-a72f-36a37ba92cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.643669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d58b554-6a9d-447a-a72f-36a37ba92cb3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.656978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8ca6e-1ce5-4893-9756-f06324d72fcd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.669352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.670067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.670900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.670900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] PATH_INFO: `/v3/projects/98581d0321b94e37b3a795f241fb0813` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.675703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98581d0321b94e37b3a795f241fb0813)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.676904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.677763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.678227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.678678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.680303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.690011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:09.710238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.712092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.736646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 948/1893] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:09.737571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.743495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.770601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d30ca-c2de-4f64-a344-c86bdb4a6ab8 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.778676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98581d0321b94e37b3a795f241fb0813', 'request_id': 'req-7163b179-9864-4d60-80fd-8e7ba534b813'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.787889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98581d0321b94e37b3a795f241fb0813', 'request_id': 'req-7163b179-9864-4d60-80fd-8e7ba534b813'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.804281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98581d0321b94e37b3a795f241fb0813', 'request_id': 'req-7163b179-9864-4d60-80fd-8e7ba534b813'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.823358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] The token cache is being invalidate because project 98581d0321b94e37b3a795f241fb0813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:09.824063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.828465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.831601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 946/1894] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:09 2022] DELETE /identity/v3/projects/98581d0321b94e37b3a795f241fb0813 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:09.838195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:09.840814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:09.853713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:09.854608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:09.855011 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:09.855608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] PATH_INFO: `/v3/projects/0147c4f2780a41c59e691fdc417931be` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:09.857128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0147c4f2780a41c59e691fdc417931be)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:09.860990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:09.946171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0147c4f2780a41c59e691fdc417931be', 'request_id': 'req-8c731cbf-46f6-422f-865a-89549dd50c3b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.958239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0147c4f2780a41c59e691fdc417931be', 'request_id': 'req-8c731cbf-46f6-422f-865a-89549dd50c3b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.974173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0147c4f2780a41c59e691fdc417931be', 'request_id': 'req-8c731cbf-46f6-422f-865a-89549dd50c3b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:09.978327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7163b179-9864-4d60-80fd-8e7ba534b813 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:09.978948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:10.005636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] The token cache is being invalidate because project 0147c4f2780a41c59e691fdc417931be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:10.007067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.007750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8c731cbf-46f6-422f-865a-89549dd50c3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.011269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 949/1895] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:09 2022] DELETE /identity/v3/projects/0147c4f2780a41c59e691fdc417931be => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:10.016236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb85f9-4136-4629-ab14-bc7b71df1412 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.016492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb85f9-4136-4629-ab14-bc7b71df1412 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.016770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb85f9-4136-4629-ab14-bc7b71df1412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.064206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bbdb85f9-4136-4629-ab14-bc7b71df1412 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:10.068331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bbdb85f9-4136-4629-ab14-bc7b71df1412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:10.100149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.100806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.101095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.101379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] PATH_INFO: `/v3/users/06514a9c6e8a45f399ce48fe31301f3f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.102564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] RBAC: Authorizing `identity:delete_user(user_id=06514a9c6e8a45f399ce48fe31301f3f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.104602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.186749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 950/1896] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:10.189050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:10.190936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75513803-843b-4dc0-84e9-b0bd5dd4a502 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.191502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75513803-843b-4dc0-84e9-b0bd5dd4a502 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.192503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75513803-843b-4dc0-84e9-b0bd5dd4a502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.199822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06514a9c6e8a45f399ce48fe31301f3f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.215025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-75513803-843b-4dc0-84e9-b0bd5dd4a502 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:10.216636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-75513803-843b-4dc0-84e9-b0bd5dd4a502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:10.226847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 951/1897] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:10.227087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06514a9c6e8a45f399ce48fe31301f3f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.228699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06514a9c6e8a45f399ce48fe31301f3f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.231080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75513803-843b-4dc0-84e9-b0bd5dd4a502 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.245687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75513803-843b-4dc0-84e9-b0bd5dd4a502 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.247203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06514a9c6e8a45f399ce48fe31301f3f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.251580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.252213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.252664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.252977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.253911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:10.254423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.256071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.266434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06514a9c6e8a45f399ce48fe31301f3f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.273183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 952/1898] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:10.274263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.279104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 947/1899] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:09 2022] DELETE /identity/v3/users/06514a9c6e8a45f399ce48fe31301f3f => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:10.280804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:10.298564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6d7cd7-c646-4d2c-974e-62835c0a705f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.408646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbdbb6-3c25-4e50-a597-e71986d2fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.409194 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbdbb6-3c25-4e50-a597-e71986d2fc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.409485 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbdbb6-3c25-4e50-a597-e71986d2fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.409767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfbdbb6-3c25-4e50-a597-e71986d2fc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.412492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbdbb6-3c25-4e50-a597-e71986d2fc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.414822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfbdbb6-3c25-4e50-a597-e71986d2fc2b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.463754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 953/1900] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:10 2022] POST /identity/v3/projects => generated 385 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:10.467599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.485813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9269fe-20f8-4ec7-8e33-bf50187a335d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.570272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c41b-50e9-4a20-88a7-9cf72213a34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.571365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c41b-50e9-4a20-88a7-9cf72213a34a admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.571710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c41b-50e9-4a20-88a7-9cf72213a34a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.572087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c41b-50e9-4a20-88a7-9cf72213a34a admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.572742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226c41b-50e9-4a20-88a7-9cf72213a34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.579455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226c41b-50e9-4a20-88a7-9cf72213a34a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.614162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 948/1901] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:10 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:10.618746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbdbb6-3c25-4e50-a597-e71986d2fc2b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.634025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfbdbb6-3c25-4e50-a597-e71986d2fc2b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.640258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.641383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.641748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.642332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.643317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.645311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.668428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 954/1902] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:10.671947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c41b-50e9-4a20-88a7-9cf72213a34a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.693532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c41b-50e9-4a20-88a7-9cf72213a34a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.699500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfad40-7199-4e7a-b7c0-814170c48ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.700677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfad40-7199-4e7a-b7c0-814170c48ffa admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.701372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfad40-7199-4e7a-b7c0-814170c48ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.701766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bfad40-7199-4e7a-b7c0-814170c48ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.702563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfad40-7199-4e7a-b7c0-814170c48ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.705087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bfad40-7199-4e7a-b7c0-814170c48ffa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.728865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 949/1903] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:10.731901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.732913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfad40-7199-4e7a-b7c0-814170c48ffa admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.734410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:10.746121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bfad40-7199-4e7a-b7c0-814170c48ffa admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.750844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf37cf-9b3b-4495-a808-4b0d771bffb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.751510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf37cf-9b3b-4495-a808-4b0d771bffb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.751956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf37cf-9b3b-4495-a808-4b0d771bffb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.752255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf37cf-9b3b-4495-a808-4b0d771bffb0 admin admin] PATH_INFO: `/v3/projects/55c1e8882fed4760906b1c4c85d6ec43/users/43aeb975fa0c4be7928f82658757d320/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.772319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf37cf-9b3b-4495-a808-4b0d771bffb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c1e8882fed4760906b1c4c85d6ec43, user_id=43aeb975fa0c4be7928f82658757d320, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.772598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b76fb4-ae34-4174-8532-feb4977dac77 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:10.776072 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf37cf-9b3b-4495-a808-4b0d771bffb0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.786374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:10.787367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.795208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.795208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] PATH_INFO: `/v3/projects/a798a16f8db34e44a30810ef37fee1d2` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.795208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a798a16f8db34e44a30810ef37fee1d2)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:10.796760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:10.806272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 950/1904] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:10 2022] PUT /identity/v3/projects/55c1e8882fed4760906b1c4c85d6ec43/users/43aeb975fa0c4be7928f82658757d320/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:10.810895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b0ec-2231-4d51-a0b9-f2c0bbcf75ff None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.811187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b0ec-2231-4d51-a0b9-f2c0bbcf75ff None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.811596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b0ec-2231-4d51-a0b9-f2c0bbcf75ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.848839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4311b0ec-2231-4d51-a0b9-f2c0bbcf75ff None None] MFA Rules not processed for user `43aeb975fa0c4be7928f82658757d320`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:10.850299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4311b0ec-2231-4d51-a0b9-f2c0bbcf75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:10.868823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:10.872834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a798a16f8db34e44a30810ef37fee1d2', 'request_id': 'req-69e2e7c0-f98f-4999-8540-4956e0ba6567'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.887720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a798a16f8db34e44a30810ef37fee1d2', 'request_id': 'req-69e2e7c0-f98f-4999-8540-4956e0ba6567'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.930952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a798a16f8db34e44a30810ef37fee1d2', 'request_id': 'req-69e2e7c0-f98f-4999-8540-4956e0ba6567'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.952947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] The token cache is being invalidate because project a798a16f8db34e44a30810ef37fee1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:10.953250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.955735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69e2e7c0-f98f-4999-8540-4956e0ba6567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:10.958361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 955/1905] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:10 2022] DELETE /identity/v3/projects/a798a16f8db34e44a30810ef37fee1d2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:10.963280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db50e59-d79a-486f-81da-c7de103b3288 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:10.963954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db50e59-d79a-486f-81da-c7de103b3288 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:10.964373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db50e59-d79a-486f-81da-c7de103b3288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:10.973567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 951/1906] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:10.990339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b0ec-2231-4d51-a0b9-f2c0bbcf75ff None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:10.991507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2db50e59-d79a-486f-81da-c7de103b3288 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:10.993049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2db50e59-d79a-486f-81da-c7de103b3288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:10.994371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4311b0ec-2231-4d51-a0b9-f2c0bbcf75ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.003348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:11.097848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b0ec-2231-4d51-a0b9-f2c0bbcf75ff None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.098759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 956/1907] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:11.102946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.103596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.103882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.104300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.106212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225581a2-f8d6-4b72-aa59-3d7bb44a231c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.107145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.107681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225581a2-f8d6-4b72-aa59-3d7bb44a231c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.108376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225581a2-f8d6-4b72-aa59-3d7bb44a231c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.120564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.123111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.135472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 952/1908] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:10 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:11.139231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-225581a2-f8d6-4b72-aa59-3d7bb44a231c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:11.140743 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-225581a2-f8d6-4b72-aa59-3d7bb44a231c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.155046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 957/1909] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:11.159105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.161322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225581a2-f8d6-4b72-aa59-3d7bb44a231c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.162041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.174546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225581a2-f8d6-4b72-aa59-3d7bb44a231c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.184069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.185069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.185408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.185756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.186545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:11.186653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801aec41-ff42-4575-b58e-263a25160c15 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.186920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.190412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.193194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.194404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.194694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.194974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] PATH_INFO: `/v3/users/43aeb975fa0c4be7928f82658757d320` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.196184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=43aeb975fa0c4be7928f82658757d320)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.198884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.207304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 958/1910] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:11.212794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.236533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae5be8-696b-4d20-93c1-ef5bd0acc4ac admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.248929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e568fb-1588-4ab9-a36d-03b7bfc12c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.250314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e568fb-1588-4ab9-a36d-03b7bfc12c2a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.250670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e568fb-1588-4ab9-a36d-03b7bfc12c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.251133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e568fb-1588-4ab9-a36d-03b7bfc12c2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.251836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e568fb-1588-4ab9-a36d-03b7bfc12c2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.253975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e568fb-1588-4ab9-a36d-03b7bfc12c2a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.277970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43aeb975fa0c4be7928f82658757d320'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:11.293934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 959/1911] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:11 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:11.294116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43aeb975fa0c4be7928f82658757d320'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:11.294834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43aeb975fa0c4be7928f82658757d320'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:11.298244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e568fb-1588-4ab9-a36d-03b7bfc12c2a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.303655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43aeb975fa0c4be7928f82658757d320'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:11.312471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-552b134e-5adf-45cb-803e-be8d3a209cfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43aeb975fa0c4be7928f82658757d320'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:11.319353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 953/1912] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:11 2022] DELETE /identity/v3/users/43aeb975fa0c4be7928f82658757d320 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:11.323579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9922-dda3-4d87-a03d-9d5404982654 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.323904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9922-dda3-4d87-a03d-9d5404982654 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.324141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d9922-dda3-4d87-a03d-9d5404982654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.347131 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5e8d9922-dda3-4d87-a03d-9d5404982654 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:11.350528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5e8d9922-dda3-4d87-a03d-9d5404982654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.391927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e568fb-1588-4ab9-a36d-03b7bfc12c2a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.478677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 954/1913] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:11.487233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:11.494670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9922-dda3-4d87-a03d-9d5404982654 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.500345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5e8d9922-dda3-4d87-a03d-9d5404982654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.510245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.511253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.511666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.512048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.513080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.516122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.527613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:11.563523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 960/1914] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:11 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:11.576337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.586686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d9922-dda3-4d87-a03d-9d5404982654 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.589499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.591282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e534f-11e5-4a2b-a8e2-280fa25f1dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.592718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e534f-11e5-4a2b-a8e2-280fa25f1dec service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.592718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e534f-11e5-4a2b-a8e2-280fa25f1dec service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.592718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e534f-11e5-4a2b-a8e2-280fa25f1dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.605627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e534f-11e5-4a2b-a8e2-280fa25f1dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.606830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79e534f-11e5-4a2b-a8e2-280fa25f1dec service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.618950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c486adea-6fac-48ab-b988-4a0470cf03e0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.619328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 955/1915] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:11.633964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f8b87-25aa-41bb-899e-eda1c1c000bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.634711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f8b87-25aa-41bb-899e-eda1c1c000bc admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.635152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f8b87-25aa-41bb-899e-eda1c1c000bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.635500 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f8b87-25aa-41bb-899e-eda1c1c000bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.636260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f8b87-25aa-41bb-899e-eda1c1c000bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.638276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f8b87-25aa-41bb-899e-eda1c1c000bc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.651063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 961/1916] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:11.655090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e534f-11e5-4a2b-a8e2-280fa25f1dec service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.669175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e534f-11e5-4a2b-a8e2-280fa25f1dec service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.677341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651795ae-132d-447e-b1df-97699e556e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.678329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651795ae-132d-447e-b1df-97699e556e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.678811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651795ae-132d-447e-b1df-97699e556e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.679272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651795ae-132d-447e-b1df-97699e556e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.680308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651795ae-132d-447e-b1df-97699e556e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.682251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651795ae-132d-447e-b1df-97699e556e25 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.696934 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 956/1917] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:11.701331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f8b87-25aa-41bb-899e-eda1c1c000bc admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.714747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f8b87-25aa-41bb-899e-eda1c1c000bc admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.720002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.720825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.721119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.721404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] PATH_INFO: `/v3/projects/8dec7a58d85c44e1915c4c47aee1e004/users/3f3524689d0543069052c78ecbe07756/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.741226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dec7a58d85c44e1915c4c47aee1e004, user_id=3f3524689d0543069052c78ecbe07756, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.743955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.777991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 962/1918] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:11 2022] PUT /identity/v3/projects/8dec7a58d85c44e1915c4c47aee1e004/users/3f3524689d0543069052c78ecbe07756/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:11.779263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063fd63-df2b-466b-83ce-ddc4cd5ec585 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.779561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063fd63-df2b-466b-83ce-ddc4cd5ec585 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.779840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063fd63-df2b-466b-83ce-ddc4cd5ec585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.813483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.814647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f063fd63-df2b-466b-83ce-ddc4cd5ec585 None None] MFA Rules not processed for user `3f3524689d0543069052c78ecbe07756`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:11.815664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.816152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f063fd63-df2b-466b-83ce-ddc4cd5ec585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:11.901140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b2df5-3628-49ad-b9cd-e7c9a0efed1f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.906457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 957/1919] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:11.908369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.909181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.909953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.910441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] PATH_INFO: `/v3/projects/250d940208a449608fbcd6f3c41caf1e` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.911517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063fd63-df2b-466b-83ce-ddc4cd5ec585 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.912673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=250d940208a449608fbcd6f3c41caf1e)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.915084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.922800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063fd63-df2b-466b-83ce-ddc4cd5ec585 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:11.930224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1f65-6022-4e2d-94bc-e5be3fc73e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:11.931432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1f65-6022-4e2d-94bc-e5be3fc73e5e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:11.931432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1f65-6022-4e2d-94bc-e5be3fc73e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:11.931729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f1f65-6022-4e2d-94bc-e5be3fc73e5e admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:11.932727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f1f65-6022-4e2d-94bc-e5be3fc73e5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:11.935096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f1f65-6022-4e2d-94bc-e5be3fc73e5e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:11.973839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 958/1920] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:11 2022] POST /identity/v3/projects => generated 389 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:11.977775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1f65-6022-4e2d-94bc-e5be3fc73e5e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:11.995209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '250d940208a449608fbcd6f3c41caf1e', 'request_id': 'req-69da716f-3f74-4f48-b99a-1e0c85595996'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.001675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '250d940208a449608fbcd6f3c41caf1e', 'request_id': 'req-69da716f-3f74-4f48-b99a-1e0c85595996'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.011518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '250d940208a449608fbcd6f3c41caf1e', 'request_id': 'req-69da716f-3f74-4f48-b99a-1e0c85595996'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.025903 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] The token cache is being invalidate because project 250d940208a449608fbcd6f3c41caf1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:12.026228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.026930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.028739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 963/1921] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:11 2022] DELETE /identity/v3/projects/250d940208a449608fbcd6f3c41caf1e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:12.032374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.034676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.069265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f1f65-6022-4e2d-94bc-e5be3fc73e5e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.072589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:12.100287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:12.146114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da716f-3f74-4f48-b99a-1e0c85595996 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.146725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.147540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.148180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.148585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.149233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.152059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.152436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.153284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.153635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.154141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] PATH_INFO: `/v3/users/d334d6fa80ef4c5ead65cf389396e64d` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.155692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d334d6fa80ef4c5ead65cf389396e64d)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.157555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.187568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 959/1922] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:11 2022] POST /identity/v3/users => generated 301 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:12.188878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.190529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.206575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74604dc3-2fdd-44ff-9030-c34cf2e86903 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.212828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812192d-3905-45d5-a396-5412a2dee3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.213509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812192d-3905-45d5-a396-5412a2dee3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.213828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812192d-3905-45d5-a396-5412a2dee3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.214184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812192d-3905-45d5-a396-5412a2dee3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.214836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812192d-3905-45d5-a396-5412a2dee3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.216528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812192d-3905-45d5-a396-5412a2dee3fd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.228956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 960/1923] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:12.233404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812192d-3905-45d5-a396-5412a2dee3fd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.240094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd334d6fa80ef4c5ead65cf389396e64d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.241406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd334d6fa80ef4c5ead65cf389396e64d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.251567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812192d-3905-45d5-a396-5412a2dee3fd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.252765 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd334d6fa80ef4c5ead65cf389396e64d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.260280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.260941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.261223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.261497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] PATH_INFO: `/v3/projects/f418bbe7c8d6439a86ab39a460529854/users/4c2f17284e204503b8e976cda27ae776/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.267140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd334d6fa80ef4c5ead65cf389396e64d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.279647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f418bbe7c8d6439a86ab39a460529854, user_id=4c2f17284e204503b8e976cda27ae776, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.283107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.285106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd334d6fa80ef4c5ead65cf389396e64d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.294700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 964/1924] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:12 2022] DELETE /identity/v3/users/d334d6fa80ef4c5ead65cf389396e64d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:12.295796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.308465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.315927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 961/1925] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:12 2022] PUT /identity/v3/projects/f418bbe7c8d6439a86ab39a460529854/users/4c2f17284e204503b8e976cda27ae776/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:12.317692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.319608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.458724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87d3ab-dcc9-47c4-832b-9c046edd01e0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.468185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.468941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.469286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.469652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] PATH_INFO: `/v3/projects/55c1e8882fed4760906b1c4c85d6ec43` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.472281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb12b1-0802-422a-81d4-b331ac08d7f1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.474065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c1e8882fed4760906b1c4c85d6ec43)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.476848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.484560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d1794-78ab-442a-9626-f9f5b6639fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.485864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1794-78ab-442a-9626-f9f5b6639fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.486465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1794-78ab-442a-9626-f9f5b6639fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.487603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d1794-78ab-442a-9626-f9f5b6639fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.489230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d1794-78ab-442a-9626-f9f5b6639fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.499299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d1794-78ab-442a-9626-f9f5b6639fc8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.521845 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 962/1926] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:12.525315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d1794-78ab-442a-9626-f9f5b6639fc8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.577493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d1794-78ab-442a-9626-f9f5b6639fc8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.590871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:12.595743 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c1e8882fed4760906b1c4c85d6ec43', 'request_id': 'req-e432e5cb-93ba-4e5b-867f-130d39004807'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.610923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c1e8882fed4760906b1c4c85d6ec43', 'request_id': 'req-e432e5cb-93ba-4e5b-867f-130d39004807'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.629777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c1e8882fed4760906b1c4c85d6ec43', 'request_id': 'req-e432e5cb-93ba-4e5b-867f-130d39004807'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.665438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] The token cache is being invalidate because project 55c1e8882fed4760906b1c4c85d6ec43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:12.665905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.667596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e432e5cb-93ba-4e5b-867f-130d39004807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:12.675785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 965/1927] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:12 2022] DELETE /identity/v3/projects/55c1e8882fed4760906b1c4c85d6ec43 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:12.677922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79895cea-9758-48d7-a8fd-b0189ba516a7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.678614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79895cea-9758-48d7-a8fd-b0189ba516a7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.678994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79895cea-9758-48d7-a8fd-b0189ba516a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.699797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa302092-aa87-4e02-a1c3-3f5d122753f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.699797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302092-aa87-4e02-a1c3-3f5d122753f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.699797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302092-aa87-4e02-a1c3-3f5d122753f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.699797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302092-aa87-4e02-a1c3-3f5d122753f5 admin admin] PATH_INFO: `/v3/projects/f418bbe7c8d6439a86ab39a460529854/users/4c2f17284e204503b8e976cda27ae776/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.701468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa302092-aa87-4e02-a1c3-3f5d122753f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f418bbe7c8d6439a86ab39a460529854, user_id=4c2f17284e204503b8e976cda27ae776, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.705779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa302092-aa87-4e02-a1c3-3f5d122753f5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:12.726381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-79895cea-9758-48d7-a8fd-b0189ba516a7 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:12.727988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-79895cea-9758-48d7-a8fd-b0189ba516a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.737361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 963/1928] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:12 2022] PUT /identity/v3/projects/f418bbe7c8d6439a86ab39a460529854/users/4c2f17284e204503b8e976cda27ae776/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:12.745425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a60ef-a6d9-4e9f-a7dc-8b890bffe54c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.746145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a60ef-a6d9-4e9f-a7dc-8b890bffe54c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.746615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a60ef-a6d9-4e9f-a7dc-8b890bffe54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.792103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:12.811990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-079a60ef-a6d9-4e9f-a7dc-8b890bffe54c None None] MFA Rules not processed for user `4c2f17284e204503b8e976cda27ae776`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:12.814020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-079a60ef-a6d9-4e9f-a7dc-8b890bffe54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.887454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 966/1929] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:12.897043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeb597-4898-4055-8d07-ed0cb4c0fd5f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.897475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeb597-4898-4055-8d07-ed0cb4c0fd5f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.897957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eeb597-4898-4055-8d07-ed0cb4c0fd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.920893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-12eeb597-4898-4055-8d07-ed0cb4c0fd5f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:12.922277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-12eeb597-4898-4055-8d07-ed0cb4c0fd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.949973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 967/1930] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:12.949973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07499e54-302d-4221-97bd-5224fbd814ca None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.949973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07499e54-302d-4221-97bd-5224fbd814ca None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.949973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07499e54-302d-4221-97bd-5224fbd814ca None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.949973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 968/1931] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:39:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:12.950467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07499e54-302d-4221-97bd-5224fbd814ca None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:12.953356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-07499e54-302d-4221-97bd-5224fbd814ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:12.975082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07499e54-302d-4221-97bd-5224fbd814ca None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:12.979952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:12.980610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:12.980890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:12.981177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] PATH_INFO: `/v3/projects/4fa80efa630c4ffa9846d5e4eba36a87` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:12.982334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa80efa630c4ffa9846d5e4eba36a87)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:12.984322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.016439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 964/1932] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:12 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:13.017596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a60ef-a6d9-4e9f-a7dc-8b890bffe54c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.030844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a60ef-a6d9-4e9f-a7dc-8b890bffe54c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.047943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa80efa630c4ffa9846d5e4eba36a87', 'request_id': 'req-3e7b2701-afad-49fe-9353-158796ec73ac'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.054009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa80efa630c4ffa9846d5e4eba36a87', 'request_id': 'req-3e7b2701-afad-49fe-9353-158796ec73ac'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.065281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa80efa630c4ffa9846d5e4eba36a87', 'request_id': 'req-3e7b2701-afad-49fe-9353-158796ec73ac'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.086028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] The token cache is being invalidate because project 4fa80efa630c4ffa9846d5e4eba36a87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:13.086698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.087439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3e7b2701-afad-49fe-9353-158796ec73ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.095316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 969/1933] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:12 2022] DELETE /identity/v3/projects/4fa80efa630c4ffa9846d5e4eba36a87 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:13.095316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38662c68-8f49-447e-ab78-a0a4681fceaa None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.095316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38662c68-8f49-447e-ab78-a0a4681fceaa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.095316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38662c68-8f49-447e-ab78-a0a4681fceaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.119336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-38662c68-8f49-447e-ab78-a0a4681fceaa None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:13.120631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-38662c68-8f49-447e-ab78-a0a4681fceaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.124409 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.125152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.125657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.126171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.126967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:13.127718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.131932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.151374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 965/1934] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:13.152450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.154776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.185431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.226006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 970/1935] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:13.227278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f4fc-673f-45d0-8375-e0246e975ca7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.227632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f4fc-673f-45d0-8375-e0246e975ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.227985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2f4fc-673f-45d0-8375-e0246e975ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.247654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff39af11-f917-40b8-8697-7a4e118f7c8d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.250999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-93c2f4fc-673f-45d0-8375-e0246e975ca7 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:13.251372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae8cf3f-9d43-45e7-9857-b2528b52dd4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.252008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8cf3f-9d43-45e7-9857-b2528b52dd4b service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.252716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8cf3f-9d43-45e7-9857-b2528b52dd4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.252822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-93c2f4fc-673f-45d0-8375-e0246e975ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.252898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae8cf3f-9d43-45e7-9857-b2528b52dd4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.254666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ae8cf3f-9d43-45e7-9857-b2528b52dd4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.266026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 971/1936] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:13.268190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2f4fc-673f-45d0-8375-e0246e975ca7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.269744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-93c2f4fc-673f-45d0-8375-e0246e975ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.284648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2f4fc-673f-45d0-8375-e0246e975ca7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.290556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.291161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.291585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.291867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.292644 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.294905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.304604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.325272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8cf3f-9d43-45e7-9857-b2528b52dd4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.326661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 972/1937] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:13.327513 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.329449 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.329725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae8cf3f-9d43-45e7-9857-b2528b52dd4b service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.340313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 966/1938] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:13.341477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c705-9b46-4452-beba-9db375826f3e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.341809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c705-9b46-4452-beba-9db375826f3e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.342077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984c705-9b46-4452-beba-9db375826f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.372855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b984c705-9b46-4452-beba-9db375826f3e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:13.374124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b984c705-9b46-4452-beba-9db375826f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.425384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2fb9d-a850-487d-95c5-c1564d5d9102 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.432418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01024d6e-e9ed-4e3a-83c9-03431c52fae9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.433118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024d6e-e9ed-4e3a-83c9-03431c52fae9 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.433477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024d6e-e9ed-4e3a-83c9-03431c52fae9 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.433824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01024d6e-e9ed-4e3a-83c9-03431c52fae9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.439532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 967/1939] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:13.443979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984c705-9b46-4452-beba-9db375826f3e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.444920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01024d6e-e9ed-4e3a-83c9-03431c52fae9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.448320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01024d6e-e9ed-4e3a-83c9-03431c52fae9 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.454062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984c705-9b46-4452-beba-9db375826f3e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.459536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80c75e-dc2f-473a-bb19-bb18554f8bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.460152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80c75e-dc2f-473a-bb19-bb18554f8bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.460602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 973/1940] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:13.460707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80c75e-dc2f-473a-bb19-bb18554f8bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.460848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80c75e-dc2f-473a-bb19-bb18554f8bc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.461481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80c75e-dc2f-473a-bb19-bb18554f8bc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.461586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01024d6e-e9ed-4e3a-83c9-03431c52fae9 service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.463815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80c75e-dc2f-473a-bb19-bb18554f8bc7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.472651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01024d6e-e9ed-4e3a-83c9-03431c52fae9 service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.478802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.479527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.479926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.480114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.480843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:13.481121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.482776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.498562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 968/1941] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/users => generated 288 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:13.498747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 974/1942] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:13.501993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80c75e-dc2f-473a-bb19-bb18554f8bc7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.502107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.516246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80c75e-dc2f-473a-bb19-bb18554f8bc7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.520642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb00fc1f-2bc1-43b7-8d79-8fd179169ab9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.523116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.523737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.524022 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.524296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.524954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.526188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4af89-1051-41fa-baad-87011036c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.526611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.526796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4af89-1051-41fa-baad-87011036c64d admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.527078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4af89-1051-41fa-baad-87011036c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.527409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4af89-1051-41fa-baad-87011036c64d admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.528160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4af89-1051-41fa-baad-87011036c64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.530129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4af89-1051-41fa-baad-87011036c64d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.538227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 969/1943] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:13.539200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.541001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.555558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e55fc77-8b5a-4f5c-963f-cc4b5a0660a1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.560930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.561624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.562093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.562529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] PATH_INFO: `/v3/users/3f3524689d0543069052c78ecbe07756` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.563853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f3524689d0543069052c78ecbe07756)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.566256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.574985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 975/1944] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:13.576710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4af89-1051-41fa-baad-87011036c64d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.630864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f3524689d0543069052c78ecbe07756'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.657927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f3524689d0543069052c78ecbe07756'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.658959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f3524689d0543069052c78ecbe07756'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.675232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f3524689d0543069052c78ecbe07756'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.683702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4af89-1051-41fa-baad-87011036c64d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.688850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51edec74-f05a-480c-ac3d-94a00f940d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.689463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edec74-f05a-480c-ac3d-94a00f940d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.689723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f3524689d0543069052c78ecbe07756'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:13.689847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edec74-f05a-480c-ac3d-94a00f940d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.690045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51edec74-f05a-480c-ac3d-94a00f940d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.690722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edec74-f05a-480c-ac3d-94a00f940d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.692732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51edec74-f05a-480c-ac3d-94a00f940d2c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.698594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 970/1945] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:13 2022] DELETE /identity/v3/users/3f3524689d0543069052c78ecbe07756 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:13.699230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.700720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.701553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.721071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 976/1946] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:13.722613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6e1d-0c06-4bd7-8225-306989ec4db6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.723692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6e1d-0c06-4bd7-8225-306989ec4db6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.724262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f6e1d-0c06-4bd7-8225-306989ec4db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.735222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:13.745031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-8d9f6e1d-0c06-4bd7-8225-306989ec4db6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:13.746367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8d9f6e1d-0c06-4bd7-8225-306989ec4db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.816141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baa4747-a825-42e8-8751-48d18070bb95 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.820942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b0ef-4f13-4e7a-8f02-e4f6fe1f23a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.823205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b0ef-4f13-4e7a-8f02-e4f6fe1f23a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.823650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b0ef-4f13-4e7a-8f02-e4f6fe1f23a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.823981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4b0ef-4f13-4e7a-8f02-e4f6fe1f23a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.825152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b0ef-4f13-4e7a-8f02-e4f6fe1f23a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.828758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c4b0ef-4f13-4e7a-8f02-e4f6fe1f23a2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.857264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 977/1947] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:13.858803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f6e1d-0c06-4bd7-8225-306989ec4db6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.870344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 971/1948] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:13 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:13.871463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b0ef-4f13-4e7a-8f02-e4f6fe1f23a2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.872446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8d9f6e1d-0c06-4bd7-8225-306989ec4db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.885579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4b0ef-4f13-4e7a-8f02-e4f6fe1f23a2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.892476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f6e1d-0c06-4bd7-8225-306989ec4db6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:13.894412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.895895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.895895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.896632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.897335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.899229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.901444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27533c17-03b6-4a86-990f-709df44fe0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:13.902757 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27533c17-03b6-4a86-990f-709df44fe0b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:13.903231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27533c17-03b6-4a86-990f-709df44fe0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:13.903678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27533c17-03b6-4a86-990f-709df44fe0b8 admin admin] PATH_INFO: `/v3/projects/36330a8840754782b40bd383e34795fa/users/a4dc2fc081e14aa4a20bcc35a55cac42/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:13.916494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 972/1949] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:13.916494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:13.917332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:13.934082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27533c17-03b6-4a86-990f-709df44fe0b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36330a8840754782b40bd383e34795fa, user_id=a4dc2fc081e14aa4a20bcc35a55cac42, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:13.937846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27533c17-03b6-4a86-990f-709df44fe0b8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:13.960335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 978/1950] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:13 2022] PUT /identity/v3/projects/36330a8840754782b40bd383e34795fa/users/a4dc2fc081e14aa4a20bcc35a55cac42/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:13.962558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27533c17-03b6-4a86-990f-709df44fe0b8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.062410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27533c17-03b6-4a86-990f-709df44fe0b8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.069708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371e918-8099-49fb-b107-752dcfd7f453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.071442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e918-8099-49fb-b107-752dcfd7f453 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.071771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e918-8099-49fb-b107-752dcfd7f453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.072054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371e918-8099-49fb-b107-752dcfd7f453 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.072973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371e918-8099-49fb-b107-752dcfd7f453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.075146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371e918-8099-49fb-b107-752dcfd7f453 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.089479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 979/1951] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:14.094919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6ef5f-74ff-474b-9323-ee7c53fac1dd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.095890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26a377-a221-44b9-b2a1-d1fbeb0e6036 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.096264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26a377-a221-44b9-b2a1-d1fbeb0e6036 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.096648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26a377-a221-44b9-b2a1-d1fbeb0e6036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.135698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bc26a377-a221-44b9-b2a1-d1fbeb0e6036 None None] MFA Rules not processed for user `a4dc2fc081e14aa4a20bcc35a55cac42`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:14.137705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bc26a377-a221-44b9-b2a1-d1fbeb0e6036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:14.199565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797625-7d54-421f-8e5f-3ae7b02edf74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.200197 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797625-7d54-421f-8e5f-3ae7b02edf74 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.200516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797625-7d54-421f-8e5f-3ae7b02edf74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.200827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70797625-7d54-421f-8e5f-3ae7b02edf74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.214465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70797625-7d54-421f-8e5f-3ae7b02edf74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.215980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70797625-7d54-421f-8e5f-3ae7b02edf74 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.226952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 973/1952] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:14.228068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797625-7d54-421f-8e5f-3ae7b02edf74 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.241392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70797625-7d54-421f-8e5f-3ae7b02edf74 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.241643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 980/1953] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:14.245804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26a377-a221-44b9-b2a1-d1fbeb0e6036 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.246213 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e53978-9234-404e-b197-fba846a25b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.246889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e53978-9234-404e-b197-fba846a25b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.247225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e53978-9234-404e-b197-fba846a25b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.247510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e53978-9234-404e-b197-fba846a25b64 admin admin] PATH_INFO: `/v3/projects/9fef1c5606054db29ad25083505718b2/users/ee57041a58164c139f8d22056bed53f7/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.252012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:14.259276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26a377-a221-44b9-b2a1-d1fbeb0e6036 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.266352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1161bc-e2a2-4d51-b7bd-bb566ab99fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.266971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1161bc-e2a2-4d51-b7bd-bb566ab99fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.267249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1161bc-e2a2-4d51-b7bd-bb566ab99fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.267523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1161bc-e2a2-4d51-b7bd-bb566ab99fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.270490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1161bc-e2a2-4d51-b7bd-bb566ab99fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.272206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e53978-9234-404e-b197-fba846a25b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fef1c5606054db29ad25083505718b2, user_id=ee57041a58164c139f8d22056bed53f7, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.272325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1161bc-e2a2-4d51-b7bd-bb566ab99fc1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.288785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e53978-9234-404e-b197-fba846a25b64 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.311228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 981/1954] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:14 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:14.312754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 974/1955] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:14 2022] PUT /identity/v3/projects/9fef1c5606054db29ad25083505718b2/users/ee57041a58164c139f8d22056bed53f7/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:14.315881 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1161bc-e2a2-4d51-b7bd-bb566ab99fc1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.324333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78189013-3336-4a7d-b6ec-acb6501fd068 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.325318 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78189013-3336-4a7d-b6ec-acb6501fd068 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.325745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78189013-3336-4a7d-b6ec-acb6501fd068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.393393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-78189013-3336-4a7d-b6ec-acb6501fd068 None None] MFA Rules not processed for user `ee57041a58164c139f8d22056bed53f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:14.395359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-78189013-3336-4a7d-b6ec-acb6501fd068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:14.404319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1161bc-e2a2-4d51-b7bd-bb566ab99fc1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.411068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a9ab5-92d8-4b0f-a5c8-938c29245fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.412024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a9ab5-92d8-4b0f-a5c8-938c29245fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.412321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a9ab5-92d8-4b0f-a5c8-938c29245fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.412597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a9ab5-92d8-4b0f-a5c8-938c29245fe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.413246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a9ab5-92d8-4b0f-a5c8-938c29245fe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.415721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a9ab5-92d8-4b0f-a5c8-938c29245fe8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.453063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 982/1956] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:14 2022] POST /identity/v3/users => generated 289 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:14.453999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a9ab5-92d8-4b0f-a5c8-938c29245fe8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.459788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:14.470000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a9ab5-92d8-4b0f-a5c8-938c29245fe8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.477952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7927a4-23ac-45ae-b7d4-7480608672f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.478580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7927a4-23ac-45ae-b7d4-7480608672f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.478868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7927a4-23ac-45ae-b7d4-7480608672f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.479146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7927a4-23ac-45ae-b7d4-7480608672f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.479856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7927a4-23ac-45ae-b7d4-7480608672f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.481633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7927a4-23ac-45ae-b7d4-7480608672f0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.512592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 983/1957] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:14.517016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 975/1958] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:14.517947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7927a4-23ac-45ae-b7d4-7480608672f0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.529142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78189013-3336-4a7d-b6ec-acb6501fd068 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.531483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-78189013-3336-4a7d-b6ec-acb6501fd068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:14.538188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7927a4-23ac-45ae-b7d4-7480608672f0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.544503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a5e74-d92a-4bad-8eee-396d7836be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.545372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a5e74-d92a-4bad-8eee-396d7836be07 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.545664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a5e74-d92a-4bad-8eee-396d7836be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.545980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531a5e74-d92a-4bad-8eee-396d7836be07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.546900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a5e74-d92a-4bad-8eee-396d7836be07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.549411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531a5e74-d92a-4bad-8eee-396d7836be07 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.563096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 984/1959] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:14.567987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a5e74-d92a-4bad-8eee-396d7836be07 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.594065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531a5e74-d92a-4bad-8eee-396d7836be07 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.603292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.604341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.604774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.605230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] PATH_INFO: `/v3/projects/5a84c6d450534556a3d2adc59ffa2b7a/users/b155c6881c624366890e115faea53264/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.631091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a84c6d450534556a3d2adc59ffa2b7a, user_id=b155c6881c624366890e115faea53264, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.631965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78189013-3336-4a7d-b6ec-acb6501fd068 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.634150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.636443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eced53-c67f-4561-8692-1edc79020390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.637131 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eced53-c67f-4561-8692-1edc79020390 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.637487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eced53-c67f-4561-8692-1edc79020390 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.638088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eced53-c67f-4561-8692-1edc79020390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.651925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 985/1960] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:14 2022] PUT /identity/v3/projects/5a84c6d450534556a3d2adc59ffa2b7a/users/b155c6881c624366890e115faea53264/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:14.652083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eced53-c67f-4561-8692-1edc79020390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.653765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eced53-c67f-4561-8692-1edc79020390 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.658994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.662467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:14.678881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 976/1961] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:14 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:14.680475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0961-5ea4-4c70-8633-c1bf59fc57ff None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.680854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0961-5ea4-4c70-8633-c1bf59fc57ff None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.681108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca0961-5ea4-4c70-8633-c1bf59fc57ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.713417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e8ca0961-5ea4-4c70-8633-c1bf59fc57ff None None] MFA Rules not processed for user `b155c6881c624366890e115faea53264`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:14.714700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e8ca0961-5ea4-4c70-8633-c1bf59fc57ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:14.742658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5338cd65-494c-4ef9-8ac8-d7878a6cd48b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.747234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.747856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.748139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.748415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] PATH_INFO: `/v3/projects/8dec7a58d85c44e1915c4c47aee1e004` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.749570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dec7a58d85c44e1915c4c47aee1e004)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.751523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.778872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 977/1962] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:14.779829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca0961-5ea4-4c70-8633-c1bf59fc57ff None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.784774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:14.794167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca0961-5ea4-4c70-8633-c1bf59fc57ff None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.805343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dec7a58d85c44e1915c4c47aee1e004', 'request_id': 'req-aa78d28c-be37-4877-ab31-d7912fd8f662'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.811282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dec7a58d85c44e1915c4c47aee1e004', 'request_id': 'req-aa78d28c-be37-4877-ab31-d7912fd8f662'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.819541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dec7a58d85c44e1915c4c47aee1e004', 'request_id': 'req-aa78d28c-be37-4877-ab31-d7912fd8f662'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.831353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] The token cache is being invalidate because project 8dec7a58d85c44e1915c4c47aee1e004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:14.831645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.832330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.833969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 986/1963] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:14 2022] DELETE /identity/v3/projects/8dec7a58d85c44e1915c4c47aee1e004 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:14.834725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.836037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:14.854899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.855803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.855991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.856167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] PATH_INFO: `/v3/users/ee57041a58164c139f8d22056bed53f7` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.857440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee57041a58164c139f8d22056bed53f7)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.859838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.861715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:14.925583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa78d28c-be37-4877-ab31-d7912fd8f662 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:14.927465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee57041a58164c139f8d22056bed53f7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.931568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0971b2c3-3dbb-4a5d-94c7-e065f401e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:14.932346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b2c3-3dbb-4a5d-94c7-e065f401e9dc admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.932777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b2c3-3dbb-4a5d-94c7-e065f401e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.933222 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0971b2c3-3dbb-4a5d-94c7-e065f401e9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.933862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971b2c3-3dbb-4a5d-94c7-e065f401e9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:14.938840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0971b2c3-3dbb-4a5d-94c7-e065f401e9dc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:14.940323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee57041a58164c139f8d22056bed53f7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.941066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee57041a58164c139f8d22056bed53f7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.951726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee57041a58164c139f8d22056bed53f7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.961371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee57041a58164c139f8d22056bed53f7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:14.971519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 978/1964] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:14 2022] DELETE /identity/v3/users/ee57041a58164c139f8d22056bed53f7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:14.971519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:14.973945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 987/1965] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:14 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:14.974340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:14.975569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca792-7f97-42d5-b053-2185f9c6de0c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:14.975857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca792-7f97-42d5-b053-2185f9c6de0c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:14.976136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fca792-7f97-42d5-b053-2185f9c6de0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:14.996100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-71fca792-7f97-42d5-b053-2185f9c6de0c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:14.997240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-71fca792-7f97-42d5-b053-2185f9c6de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:15.057018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438726ce-cad0-445a-8759-44a5ef307db2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.069223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 988/1966] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:15.070189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca792-7f97-42d5-b053-2185f9c6de0c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.071532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-71fca792-7f97-42d5-b053-2185f9c6de0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:15.084367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fca792-7f97-42d5-b053-2185f9c6de0c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.089593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.090249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.090535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.090814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.091448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.093628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.118606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 989/1967] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:15 2022] POST /identity/v3/users => generated 295 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:15.119367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.122297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:15.128569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.129979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.130264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.130608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] PATH_INFO: `/v3/users/4c2f17284e204503b8e976cda27ae776` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.132296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2f17284e204503b8e976cda27ae776)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.134283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.165728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:15.176645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:15.198162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2f17284e204503b8e976cda27ae776'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:15.214449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2f17284e204503b8e976cda27ae776'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:15.214640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7d5d4e-dfc0-41f9-b875-3409a303d155 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.215336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2f17284e204503b8e976cda27ae776'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:15.218286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7eb2-f0cd-4e18-85b7-4f1287b5b83d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.219193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7eb2-f0cd-4e18-85b7-4f1287b5b83d service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.219193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7eb2-f0cd-4e18-85b7-4f1287b5b83d service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.219486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f7eb2-f0cd-4e18-85b7-4f1287b5b83d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.226095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2f17284e204503b8e976cda27ae776'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:15.229245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f7eb2-f0cd-4e18-85b7-4f1287b5b83d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.236440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99f7eb2-f0cd-4e18-85b7-4f1287b5b83d service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.239100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2f17284e204503b8e976cda27ae776'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:15.247252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 979/1968] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:14 2022] DELETE /identity/v3/users/4c2f17284e204503b8e976cda27ae776 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:15.249472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.253483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:15.256032 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 990/1969] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:15.352560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea70a4-b2fe-4560-8e12-6882b58d60b2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.358882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e50f8-76aa-4b74-bf30-f39255c962d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.359682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e50f8-76aa-4b74-bf30-f39255c962d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.360041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e50f8-76aa-4b74-bf30-f39255c962d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.360512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e50f8-76aa-4b74-bf30-f39255c962d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.361338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e50f8-76aa-4b74-bf30-f39255c962d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.363185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e50f8-76aa-4b74-bf30-f39255c962d6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.376014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 980/1970] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:15.381288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7eb2-f0cd-4e18-85b7-4f1287b5b83d service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.393529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f7eb2-f0cd-4e18-85b7-4f1287b5b83d service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.398809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ef1f-0bed-44df-b90c-189540031304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.399546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ef1f-0bed-44df-b90c-189540031304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.399839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ef1f-0bed-44df-b90c-189540031304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.400109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ef1f-0bed-44df-b90c-189540031304 admin admin] PATH_INFO: `/v3/projects/9c3b87ee538b4199b024fb456392b4a5/users/d6dda6c137ba42779568ef8f26d7f0bd/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.422091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6ef1f-0bed-44df-b90c-189540031304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3b87ee538b4199b024fb456392b4a5, user_id=d6dda6c137ba42779568ef8f26d7f0bd, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.425298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c6ef1f-0bed-44df-b90c-189540031304 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.454525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 991/1971] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:15 2022] PUT /identity/v3/projects/9c3b87ee538b4199b024fb456392b4a5/users/d6dda6c137ba42779568ef8f26d7f0bd/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:15.460955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e50f8-76aa-4b74-bf30-f39255c962d6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.476958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e50f8-76aa-4b74-bf30-f39255c962d6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.630089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc94c55-48cc-4cab-878f-5e67324eadea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.631110 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94c55-48cc-4cab-878f-5e67324eadea admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.631631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94c55-48cc-4cab-878f-5e67324eadea admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.632456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc94c55-48cc-4cab-878f-5e67324eadea admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.633601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc94c55-48cc-4cab-878f-5e67324eadea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.635559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc94c55-48cc-4cab-878f-5e67324eadea admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.648737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 981/1972] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:15 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:15.653216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ef1f-0bed-44df-b90c-189540031304 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.666340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c6ef1f-0bed-44df-b90c-189540031304 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:15.672322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:15.673036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.673325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.673606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] PATH_INFO: `/v3/projects/9c3b87ee538b4199b024fb456392b4a5/users/d6dda6c137ba42779568ef8f26d7f0bd/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.676743 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c3b87ee538b4199b024fb456392b4a5, user_id=d6dda6c137ba42779568ef8f26d7f0bd, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:15.679655 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:15.695140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 992/1973] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:15 2022] PUT /identity/v3/projects/9c3b87ee538b4199b024fb456392b4a5/users/d6dda6c137ba42779568ef8f26d7f0bd/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:15.706379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecdabe-e88e-43c2-a3e3-7bee4974a95f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:15.706818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecdabe-e88e-43c2-a3e3-7bee4974a95f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:15.708246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcecdabe-e88e-43c2-a3e3-7bee4974a95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:15.748093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-dcecdabe-e88e-43c2-a3e3-7bee4974a95f None None] MFA Rules not processed for user `d6dda6c137ba42779568ef8f26d7f0bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:15.751226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dcecdabe-e88e-43c2-a3e3-7bee4974a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:15.794828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:15.853249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 982/1974] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:15.867197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.869391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:15.896973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecdabe-e88e-43c2-a3e3-7bee4974a95f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:15.899263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dcecdabe-e88e-43c2-a3e3-7bee4974a95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:16.050604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcecdabe-e88e-43c2-a3e3-7bee4974a95f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.070067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.072606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.072885 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.073160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] PATH_INFO: `/v3/projects/9fef1c5606054db29ad25083505718b2` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.076436 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fef1c5606054db29ad25083505718b2)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.078725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.080531 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abde4d-2488-44f5-b211-1d1f32a11a34 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.084421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.085049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.085337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.086970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.088887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:16.134653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fef1c5606054db29ad25083505718b2', 'request_id': 'req-16a0b61d-ff88-43c6-a1f9-1c665d910861'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.140847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fef1c5606054db29ad25083505718b2', 'request_id': 'req-16a0b61d-ff88-43c6-a1f9-1c665d910861'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.149569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fef1c5606054db29ad25083505718b2', 'request_id': 'req-16a0b61d-ff88-43c6-a1f9-1c665d910861'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.152085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.153554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.160928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] The token cache is being invalidate because project 9fef1c5606054db29ad25083505718b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:16.161327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.162023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-16a0b61d-ff88-43c6-a1f9-1c665d910861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.163394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 993/1975] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:16.163852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 983/1976] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:15 2022] DELETE /identity/v3/projects/9fef1c5606054db29ad25083505718b2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:16.166085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.166222 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:16.175683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da19c-007b-4e75-9712-e866318f190a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.176593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da19c-007b-4e75-9712-e866318f190a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.177578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7da19c-007b-4e75-9712-e866318f190a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.183354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fd3b8-a947-4157-b19b-d0d9dd27accb service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.204915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ad7da19c-007b-4e75-9712-e866318f190a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:16.209708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ad7da19c-007b-4e75-9712-e866318f190a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:16.240461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:16.269213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.270148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.270554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.271214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] PATH_INFO: `/v3/projects/f418bbe7c8d6439a86ab39a460529854` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.272581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f418bbe7c8d6439a86ab39a460529854)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.274807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.281249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:16.306215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 984/1977] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:16.308741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2d0f-7c8e-419a-80a6-efb6f4f00789 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.309034 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2d0f-7c8e-419a-80a6-efb6f4f00789 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.309311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a2d0f-7c8e-419a-80a6-efb6f4f00789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.329860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-391a2d0f-7c8e-419a-80a6-efb6f4f00789 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:16.331422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-391a2d0f-7c8e-419a-80a6-efb6f4f00789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:16.344330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 985/1978] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:16.345243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2d0f-7c8e-419a-80a6-efb6f4f00789 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.356665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a2d0f-7c8e-419a-80a6-efb6f4f00789 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.362213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f418bbe7c8d6439a86ab39a460529854', 'request_id': 'req-8dbc363f-e666-4404-90d4-0d6460f481a8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.371178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f418bbe7c8d6439a86ab39a460529854', 'request_id': 'req-8dbc363f-e666-4404-90d4-0d6460f481a8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.381207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f418bbe7c8d6439a86ab39a460529854', 'request_id': 'req-8dbc363f-e666-4404-90d4-0d6460f481a8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.396685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] The token cache is being invalidate because project f418bbe7c8d6439a86ab39a460529854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:16.397092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.398035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8dbc363f-e666-4404-90d4-0d6460f481a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:16.400142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 994/1979] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:16 2022] DELETE /identity/v3/projects/f418bbe7c8d6439a86ab39a460529854 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:16.405082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d874cc-d5be-4d26-9c2a-d5c4589ca430 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.406456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d874cc-d5be-4d26-9c2a-d5c4589ca430 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.406827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d874cc-d5be-4d26-9c2a-d5c4589ca430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.450871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f2d874cc-d5be-4d26-9c2a-d5c4589ca430 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:16.452507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f2d874cc-d5be-4d26-9c2a-d5c4589ca430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:16.463016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.464124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.464797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.465235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.466900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:16.467483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.471726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.491373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 986/1980] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:16.494704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.497115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:16.518214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ae009-2169-41d2-b2a6-65504e64a79c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.525658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee35d75-5ea6-46bc-a633-68506f7c3724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.527099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee35d75-5ea6-46bc-a633-68506f7c3724 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.527099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee35d75-5ea6-46bc-a633-68506f7c3724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.527099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee35d75-5ea6-46bc-a633-68506f7c3724 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.528266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee35d75-5ea6-46bc-a633-68506f7c3724 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.529885 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee35d75-5ea6-46bc-a633-68506f7c3724 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.601928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 995/1981] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:16.607575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1113be-64aa-4fc1-bbf4-26ac92ae7e86 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.607869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1113be-64aa-4fc1-bbf4-26ac92ae7e86 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.608145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1113be-64aa-4fc1-bbf4-26ac92ae7e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.611283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 987/1982] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:16 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:16.616190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee35d75-5ea6-46bc-a633-68506f7c3724 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.633339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-cd1113be-64aa-4fc1-bbf4-26ac92ae7e86 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:16.635605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cd1113be-64aa-4fc1-bbf4-26ac92ae7e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:16.751305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee35d75-5ea6-46bc-a633-68506f7c3724 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.762958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00b2a-e5dd-4b85-ad2c-4ae4820d4282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.763627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00b2a-e5dd-4b85-ad2c-4ae4820d4282 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.763897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00b2a-e5dd-4b85-ad2c-4ae4820d4282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.764171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00b2a-e5dd-4b85-ad2c-4ae4820d4282 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.765513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00b2a-e5dd-4b85-ad2c-4ae4820d4282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.766945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00b2a-e5dd-4b85-ad2c-4ae4820d4282 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.781962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 996/1983] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:16.788858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1113be-64aa-4fc1-bbf4-26ac92ae7e86 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.802688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1113be-64aa-4fc1-bbf4-26ac92ae7e86 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.808775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.809988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.810457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.810868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.811696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:16.812212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.814326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.814783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 988/1984] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:16 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:16.819749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00b2a-e5dd-4b85-ad2c-4ae4820d4282 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.830953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00b2a-e5dd-4b85-ad2c-4ae4820d4282 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.838327 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:16.846314 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1af00-9298-4e6b-a300-3a32c80703a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.846314 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1af00-9298-4e6b-a300-3a32c80703a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.846314 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1af00-9298-4e6b-a300-3a32c80703a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.849184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d1af00-9298-4e6b-a300-3a32c80703a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.850012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1af00-9298-4e6b-a300-3a32c80703a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.850216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 997/1985] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:16.851408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.852531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d1af00-9298-4e6b-a300-3a32c80703a9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.865962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df55e4-35fa-4285-b291-7f618ad183ff admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.873571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc6425-8568-41a8-a7bf-9da2758bb873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.877308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 989/1986] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:16.878368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6425-8568-41a8-a7bf-9da2758bb873 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.878833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6425-8568-41a8-a7bf-9da2758bb873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.879189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1af00-9298-4e6b-a300-3a32c80703a9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.879615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc6425-8568-41a8-a7bf-9da2758bb873 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.880951 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc6425-8568-41a8-a7bf-9da2758bb873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.883830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc6425-8568-41a8-a7bf-9da2758bb873 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.914926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d1af00-9298-4e6b-a300-3a32c80703a9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:16.928232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfc3f5-ab52-4580-ab4c-98893b33cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:16.929020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc3f5-ab52-4580-ab4c-98893b33cb1c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:16.933533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc3f5-ab52-4580-ab4c-98893b33cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:16.933673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 998/1987] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:16 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:16.934520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cfc3f5-ab52-4580-ab4c-98893b33cb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:16.934868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfc3f5-ab52-4580-ab4c-98893b33cb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:16.936891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cfc3f5-ab52-4580-ab4c-98893b33cb1c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:16.937577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc6425-8568-41a8-a7bf-9da2758bb873 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.963707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 990/1988] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:16.967985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfc3f5-ab52-4580-ab4c-98893b33cb1c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:16.993533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cfc3f5-ab52-4580-ab4c-98893b33cb1c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.056735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:17.120726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc6425-8568-41a8-a7bf-9da2758bb873 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.126493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674f950-4582-4cdb-97ce-d30400f62841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.127297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674f950-4582-4cdb-97ce-d30400f62841 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.127815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674f950-4582-4cdb-97ce-d30400f62841 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.128210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674f950-4582-4cdb-97ce-d30400f62841 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.129009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674f950-4582-4cdb-97ce-d30400f62841 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.129491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f724f4e6-a71d-47b5-9e18-a097821e5e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.131872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674f950-4582-4cdb-97ce-d30400f62841 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.145715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f4e6-a71d-47b5-9e18-a097821e5e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.146567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f4e6-a71d-47b5-9e18-a097821e5e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.146567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f724f4e6-a71d-47b5-9e18-a097821e5e04 admin admin] PATH_INFO: `/v3/projects/8a773355241c4fc7a17b32da489c147b/users/973fdc43066243638667b7aa395e342a/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.163759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 999/1989] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:16 2022] POST /identity/v3/users => generated 290 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:17.173987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724f4e6-a71d-47b5-9e18-a097821e5e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a773355241c4fc7a17b32da489c147b, user_id=973fdc43066243638667b7aa395e342a, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.175438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674f950-4582-4cdb-97ce-d30400f62841 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.177489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f724f4e6-a71d-47b5-9e18-a097821e5e04 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.189493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674f950-4582-4cdb-97ce-d30400f62841 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.196939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 991/1990] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:16 2022] PUT /identity/v3/projects/8a773355241c4fc7a17b32da489c147b/users/973fdc43066243638667b7aa395e342a/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:17.208493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5419d-8f73-4aa7-b3db-57241b34cfbc None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.208822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5419d-8f73-4aa7-b3db-57241b34cfbc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.209085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5419d-8f73-4aa7-b3db-57241b34cfbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.245577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e0f5419d-8f73-4aa7-b3db-57241b34cfbc None None] MFA Rules not processed for user `973fdc43066243638667b7aa395e342a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:17.247632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e0f5419d-8f73-4aa7-b3db-57241b34cfbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:17.267847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b841c17-480d-4271-adc3-b3705040e421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.269215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b841c17-480d-4271-adc3-b3705040e421 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.269215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b841c17-480d-4271-adc3-b3705040e421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.269530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b841c17-480d-4271-adc3-b3705040e421 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.271066 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b841c17-480d-4271-adc3-b3705040e421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.273196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b841c17-480d-4271-adc3-b3705040e421 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.288288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1000/1991] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:17.293897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b841c17-480d-4271-adc3-b3705040e421 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.318566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b841c17-480d-4271-adc3-b3705040e421 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.328561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937af0f-6179-40f4-9011-11fe725844c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.329967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937af0f-6179-40f4-9011-11fe725844c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.330457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937af0f-6179-40f4-9011-11fe725844c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.330732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7937af0f-6179-40f4-9011-11fe725844c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.331599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937af0f-6179-40f4-9011-11fe725844c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.335149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7937af0f-6179-40f4-9011-11fe725844c1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.347259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1001/1992] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:17.351509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937af0f-6179-40f4-9011-11fe725844c1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.356021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 992/1993] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:17.360568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5419d-8f73-4aa7-b3db-57241b34cfbc None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.366792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7937af0f-6179-40f4-9011-11fe725844c1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.374796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5419d-8f73-4aa7-b3db-57241b34cfbc None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.375327 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d617cf9d-7634-4782-8b9e-35108b63fac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.376403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617cf9d-7634-4782-8b9e-35108b63fac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.376966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617cf9d-7634-4782-8b9e-35108b63fac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.377543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d617cf9d-7634-4782-8b9e-35108b63fac8 admin admin] PATH_INFO: `/v3/projects/f24fff3a97224dfe98cffb98c322778f/users/35d9749797624486a65280dfbca4dd30/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.380610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f1cb-7bf5-4744-94de-3e991bde734e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.381323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f1cb-7bf5-4744-94de-3e991bde734e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.381616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f1cb-7bf5-4744-94de-3e991bde734e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.381905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3880f1cb-7bf5-4744-94de-3e991bde734e admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.382618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880f1cb-7bf5-4744-94de-3e991bde734e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.385183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3880f1cb-7bf5-4744-94de-3e991bde734e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.401918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617cf9d-7634-4782-8b9e-35108b63fac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f24fff3a97224dfe98cffb98c322778f, user_id=35d9749797624486a65280dfbca4dd30, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.406086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d617cf9d-7634-4782-8b9e-35108b63fac8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.428117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 993/1994] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:17.429608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f1cb-7bf5-4744-94de-3e991bde734e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.429914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1002/1995] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:17 2022] PUT /identity/v3/projects/f24fff3a97224dfe98cffb98c322778f/users/35d9749797624486a65280dfbca4dd30/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:17.453769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d424-c5a7-4e0b-9f9e-9091c42e4483 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.459893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d424-c5a7-4e0b-9f9e-9091c42e4483 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.460397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d424-c5a7-4e0b-9f9e-9091c42e4483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.529349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d9d8d424-c5a7-4e0b-9f9e-9091c42e4483 None None] MFA Rules not processed for user `35d9749797624486a65280dfbca4dd30`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:17.530911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d9d8d424-c5a7-4e0b-9f9e-9091c42e4483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:17.568057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:17.582798 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3880f1cb-7bf5-4744-94de-3e991bde734e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.596229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a341d5d-6d91-41f4-a5a0-870581634dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.599880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341d5d-6d91-41f4-a5a0-870581634dad admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.600187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341d5d-6d91-41f4-a5a0-870581634dad admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.600438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a341d5d-6d91-41f4-a5a0-870581634dad admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.601096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a341d5d-6d91-41f4-a5a0-870581634dad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.607481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a341d5d-6d91-41f4-a5a0-870581634dad admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.640793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1003/1996] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:17.645360 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 994/1997] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:17.646367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a341d5d-6d91-41f4-a5a0-870581634dad admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.647183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8d424-c5a7-4e0b-9f9e-9091c42e4483 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.657669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a341d5d-6d91-41f4-a5a0-870581634dad admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.663735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3eb08-41e8-4087-bd7e-58d13d72e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.664161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d8d424-c5a7-4e0b-9f9e-9091c42e4483 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.664500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3eb08-41e8-4087-bd7e-58d13d72e062 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.664897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3eb08-41e8-4087-bd7e-58d13d72e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.665567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3eb08-41e8-4087-bd7e-58d13d72e062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.666483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3eb08-41e8-4087-bd7e-58d13d72e062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.668157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3eb08-41e8-4087-bd7e-58d13d72e062 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.670136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:17.671645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c898-37ac-47da-be59-057b69f7fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.672426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c898-37ac-47da-be59-057b69f7fdd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.672744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c898-37ac-47da-be59-057b69f7fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.673731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0c898-37ac-47da-be59-057b69f7fdd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.673987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0c898-37ac-47da-be59-057b69f7fdd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.677091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0c898-37ac-47da-be59-057b69f7fdd8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.682965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 995/1998] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:17.687571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3eb08-41e8-4087-bd7e-58d13d72e062 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.700794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3eb08-41e8-4087-bd7e-58d13d72e062 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.707172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df4dc4-07e9-43b5-b86d-302b0bfebdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.708314 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4dc4-07e9-43b5-b86d-302b0bfebdc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.709255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4dc4-07e9-43b5-b86d-302b0bfebdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.709693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df4dc4-07e9-43b5-b86d-302b0bfebdc3 admin admin] PATH_INFO: `/v3/projects/78f3819770204e08b7173ec4a75ddf54/users/1fa87aa1ca254d4b84777d948eb9c971/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.739516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1004/1999] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/projects => generated 381 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:17.740448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c898-37ac-47da-be59-057b69f7fdd8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.741800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df4dc4-07e9-43b5-b86d-302b0bfebdc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f3819770204e08b7173ec4a75ddf54, user_id=1fa87aa1ca254d4b84777d948eb9c971, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.745594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df4dc4-07e9-43b5-b86d-302b0bfebdc3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.779470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 996/2000] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:17 2022] PUT /identity/v3/projects/78f3819770204e08b7173ec4a75ddf54/users/1fa87aa1ca254d4b84777d948eb9c971/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:17.784155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df4dc4-07e9-43b5-b86d-302b0bfebdc3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.845321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0c898-37ac-47da-be59-057b69f7fdd8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.862468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df4dc4-07e9-43b5-b86d-302b0bfebdc3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.868140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9b2f9-652c-40cc-aae1-72f0783b447d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.868759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9b2f9-652c-40cc-aae1-72f0783b447d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.869055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9b2f9-652c-40cc-aae1-72f0783b447d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.869315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc9b2f9-652c-40cc-aae1-72f0783b447d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.876014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9b2f9-652c-40cc-aae1-72f0783b447d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.877653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc9b2f9-652c-40cc-aae1-72f0783b447d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.889420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 997/2001] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:17.894046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9b2f9-652c-40cc-aae1-72f0783b447d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.915670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b408e-eb57-4c90-9095-00efe85725b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.916302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b408e-eb57-4c90-9095-00efe85725b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.916584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b408e-eb57-4c90-9095-00efe85725b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.916857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b408e-eb57-4c90-9095-00efe85725b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.917490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b408e-eb57-4c90-9095-00efe85725b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.918872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc9b2f9-652c-40cc-aae1-72f0783b447d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:17.919716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b408e-eb57-4c90-9095-00efe85725b7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.925417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697635b-f4ca-4442-baa5-6aef6803b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:17.927154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697635b-f4ca-4442-baa5-6aef6803b38e admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.927776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697635b-f4ca-4442-baa5-6aef6803b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.928062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697635b-f4ca-4442-baa5-6aef6803b38e admin admin] PATH_INFO: `/v3/projects/78f3819770204e08b7173ec4a75ddf54/users/1fa87aa1ca254d4b84777d948eb9c971/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:17.930378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697635b-f4ca-4442-baa5-6aef6803b38e admin admin] RBAC: Authorizing `identity:create_grant(project_id=78f3819770204e08b7173ec4a75ddf54, user_id=1fa87aa1ca254d4b84777d948eb9c971, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:17.933334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697635b-f4ca-4442-baa5-6aef6803b38e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:17.947145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 998/2002] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:17 2022] PUT /identity/v3/projects/78f3819770204e08b7173ec4a75ddf54/users/1fa87aa1ca254d4b84777d948eb9c971/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:17.949702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1005/2003] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/users => generated 297 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:17.953739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697635b-f4ca-4442-baa5-6aef6803b38e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:17.980402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051490f-2ab9-4dda-8958-1c8adc8ebbde None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:17.980402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051490f-2ab9-4dda-8958-1c8adc8ebbde None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:17.980402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051490f-2ab9-4dda-8958-1c8adc8ebbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.022790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6051490f-2ab9-4dda-8958-1c8adc8ebbde None None] MFA Rules not processed for user `1fa87aa1ca254d4b84777d948eb9c971`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:18.024212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6051490f-2ab9-4dda-8958-1c8adc8ebbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:18.078339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.156555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697635b-f4ca-4442-baa5-6aef6803b38e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.162482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.163074 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.163388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.163768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.164401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.166552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.185867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 999/2004] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:18.185867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.186711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1006/2005] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:18.187590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051490f-2ab9-4dda-8958-1c8adc8ebbde None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.187827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:18.201585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051490f-2ab9-4dda-8958-1c8adc8ebbde None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.209165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.209923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.210347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.210637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] PATH_INFO: `/v3/projects/8e1b0dbd43b94201bdad8ed394fc60d8/users/80fe4afdfb9942d8a5964dfcc4cef8de/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.239723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1b0dbd43b94201bdad8ed394fc60d8, user_id=80fe4afdfb9942d8a5964dfcc4cef8de, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.246106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.264179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c272443-7058-4bcc-834a-e69f4c840b93 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.264758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1007/2006] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:18 2022] PUT /identity/v3/projects/8e1b0dbd43b94201bdad8ed394fc60d8/users/80fe4afdfb9942d8a5964dfcc4cef8de/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:18.267931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.267931 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:18.270866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.328116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.328737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.329632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.329941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.331870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:18.332549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba16482-01d1-486b-98d9-b5d276ff6a02 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.336123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943d170-2555-4a4a-8e27-fcffe8cc6050 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.336729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943d170-2555-4a4a-8e27-fcffe8cc6050 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.337010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943d170-2555-4a4a-8e27-fcffe8cc6050 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.337288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1943d170-2555-4a4a-8e27-fcffe8cc6050 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.394543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.395965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.398380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943d170-2555-4a4a-8e27-fcffe8cc6050 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.399817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1943d170-2555-4a4a-8e27-fcffe8cc6050 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.405183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1000/2007] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:18.406001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.408761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1008/2008] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:18.483191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fd469-c1b3-4643-bc0c-4a0c9312fd85 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.492326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57261075-db97-46d3-a60b-05130db16cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.493601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57261075-db97-46d3-a60b-05130db16cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.493913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57261075-db97-46d3-a60b-05130db16cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.494199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57261075-db97-46d3-a60b-05130db16cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.495073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57261075-db97-46d3-a60b-05130db16cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.496728 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57261075-db97-46d3-a60b-05130db16cf5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.510394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1001/2009] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:18.515106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943d170-2555-4a4a-8e27-fcffe8cc6050 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.534192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1943d170-2555-4a4a-8e27-fcffe8cc6050 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.541255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356343-a12d-4660-8361-b3b2efdc1dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.542306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356343-a12d-4660-8361-b3b2efdc1dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.542775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356343-a12d-4660-8361-b3b2efdc1dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.543358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b356343-a12d-4660-8361-b3b2efdc1dda admin admin] PATH_INFO: `/v3/projects/8e1b0dbd43b94201bdad8ed394fc60d8/users/80fe4afdfb9942d8a5964dfcc4cef8de/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.546535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356343-a12d-4660-8361-b3b2efdc1dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e1b0dbd43b94201bdad8ed394fc60d8, user_id=80fe4afdfb9942d8a5964dfcc4cef8de, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.550243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b356343-a12d-4660-8361-b3b2efdc1dda admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.573057 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1009/2010] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:18 2022] PUT /identity/v3/projects/8e1b0dbd43b94201bdad8ed394fc60d8/users/80fe4afdfb9942d8a5964dfcc4cef8de/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:18.584173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b23b62-2fb9-4c90-ab71-71b0c912a4fe None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.585084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b23b62-2fb9-4c90-ab71-71b0c912a4fe None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.585084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b23b62-2fb9-4c90-ab71-71b0c912a4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.643060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-94b23b62-2fb9-4c90-ab71-71b0c912a4fe None None] MFA Rules not processed for user `80fe4afdfb9942d8a5964dfcc4cef8de`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:18.644324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-94b23b62-2fb9-4c90-ab71-71b0c912a4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:18.719493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.763209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1002/2011] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:18.863197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356343-a12d-4660-8361-b3b2efdc1dda admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:18.922561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:18.945571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b356343-a12d-4660-8361-b3b2efdc1dda admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:18.949249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1dec9-92b1-4735-859d-b3c6208f258c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:18.949864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1dec9-92b1-4735-859d-b3c6208f258c service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:18.950174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1dec9-92b1-4735-859d-b3c6208f258c service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:18.950448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac1dec9-92b1-4735-859d-b3c6208f258c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:18.965494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1dec9-92b1-4735-859d-b3c6208f258c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:18.967358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac1dec9-92b1-4735-859d-b3c6208f258c service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:18.978701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1010/2012] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:19.450042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b23b62-2fb9-4c90-ab71-71b0c912a4fe None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.466418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b23b62-2fb9-4c90-ab71-71b0c912a4fe None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.470770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4caa9-f758-4563-92d1-00ccfb8ecff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.471527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4caa9-f758-4563-92d1-00ccfb8ecff1 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.471903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4caa9-f758-4563-92d1-00ccfb8ecff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.472250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4caa9-f758-4563-92d1-00ccfb8ecff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.479653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-60c4caa9-f758-4563-92d1-00ccfb8ecff1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:19.580806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4caa9-f758-4563-92d1-00ccfb8ecff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.583140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4caa9-f758-4563-92d1-00ccfb8ecff1 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.593628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1003/2013] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:19.725953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1dec9-92b1-4735-859d-b3c6208f258c service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:19.793830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac1dec9-92b1-4735-859d-b3c6208f258c service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:19.799969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:19.801358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.801477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.801902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] PATH_INFO: `/v3/users/35d9749797624486a65280dfbca4dd30` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.803309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35d9749797624486a65280dfbca4dd30)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:19.807557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:19.868323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35d9749797624486a65280dfbca4dd30'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:19.869053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35d9749797624486a65280dfbca4dd30'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:19.879935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35d9749797624486a65280dfbca4dd30'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:19.889008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35d9749797624486a65280dfbca4dd30'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:19.902898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35d9749797624486a65280dfbca4dd30'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:19.911002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1011/2014] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:19 2022] DELETE /identity/v3/users/35d9749797624486a65280dfbca4dd30 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:19.916187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f748ff-5b1e-4c8a-bce6-6c32d7893510 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:19.916801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f748ff-5b1e-4c8a-bce6-6c32d7893510 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:19.917088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f748ff-5b1e-4c8a-bce6-6c32d7893510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:19.938544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c1f748ff-5b1e-4c8a-bce6-6c32d7893510 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:19.941160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c1f748ff-5b1e-4c8a-bce6-6c32d7893510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:20.020134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1004/2015] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:20.031025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:20.032738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:20.105103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8f18c-92dd-4076-8696-358406801f19 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:20.110063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6f938-a43f-4ffd-8e25-034597625456 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:20.110845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6f938-a43f-4ffd-8e25-034597625456 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:20.111242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6f938-a43f-4ffd-8e25-034597625456 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:20.111808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf6f938-a43f-4ffd-8e25-034597625456 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:20.124177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6f938-a43f-4ffd-8e25-034597625456 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:20.125867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf6f938-a43f-4ffd-8e25-034597625456 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:20.136010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:20.142366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1012/2016] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:20.603736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f748ff-5b1e-4c8a-bce6-6c32d7893510 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:20.605529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c1f748ff-5b1e-4c8a-bce6-6c32d7893510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:20.632191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f748ff-5b1e-4c8a-bce6-6c32d7893510 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:20.639645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:20.647852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:20.648167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:20.648581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] PATH_INFO: `/v3/projects/f24fff3a97224dfe98cffb98c322778f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:20.649984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f24fff3a97224dfe98cffb98c322778f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:20.651895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:20.715473 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f24fff3a97224dfe98cffb98c322778f', 'request_id': 'req-671ca295-88b1-48f7-a749-22b6479d5a1e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:20.728636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f24fff3a97224dfe98cffb98c322778f', 'request_id': 'req-671ca295-88b1-48f7-a749-22b6479d5a1e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:20.752408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f24fff3a97224dfe98cffb98c322778f', 'request_id': 'req-671ca295-88b1-48f7-a749-22b6479d5a1e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:20.780452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:20.789041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] The token cache is being invalidate because project f24fff3a97224dfe98cffb98c322778f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:20.789381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:20.790154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:20.794834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1005/2017] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:20 2022] DELETE /identity/v3/projects/f24fff3a97224dfe98cffb98c322778f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:20.797123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6f938-a43f-4ffd-8e25-034597625456 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:20.818736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf6f938-a43f-4ffd-8e25-034597625456 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:20.911000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:20.911897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:20.912357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:20.912792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] PATH_INFO: `/v3/users/80fe4afdfb9942d8a5964dfcc4cef8de` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:20.914230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fe4afdfb9942d8a5964dfcc4cef8de)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:20.916575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:21.007620 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fe4afdfb9942d8a5964dfcc4cef8de'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.008575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fe4afdfb9942d8a5964dfcc4cef8de'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.020548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fe4afdfb9942d8a5964dfcc4cef8de'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.031744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fe4afdfb9942d8a5964dfcc4cef8de'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.053168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fe4afdfb9942d8a5964dfcc4cef8de'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.064450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1013/2018] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:20 2022] DELETE /identity/v3/users/80fe4afdfb9942d8a5964dfcc4cef8de => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:21.381823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:21.383395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.402463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ca295-88b1-48f7-a749-22b6479d5a1e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:21.403584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:21.405700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.492372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:21.494203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:21.495098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:21.495396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] PATH_INFO: `/v3/users/973fdc43066243638667b7aa395e342a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:21.499605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74522-9f99-4701-b849-229d7120848e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:21.503500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=973fdc43066243638667b7aa395e342a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:21.505143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:21.505967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:21.506257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:21.506381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:21.506538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] PATH_INFO: `/v3/users/f6e99b5ff345464faa9634db4389f3f7` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:21.507864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e99b5ff345464faa9634db4389f3f7)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:21.510108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:21.561448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:21.569823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '973fdc43066243638667b7aa395e342a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.596319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '973fdc43066243638667b7aa395e342a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.597126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '973fdc43066243638667b7aa395e342a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.600876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e99b5ff345464faa9634db4389f3f7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.601723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e99b5ff345464faa9634db4389f3f7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.606533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '973fdc43066243638667b7aa395e342a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.610994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e99b5ff345464faa9634db4389f3f7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.616778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '973fdc43066243638667b7aa395e342a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.621146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e99b5ff345464faa9634db4389f3f7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.623624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1006/2019] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:21 2022] DELETE /identity/v3/users/973fdc43066243638667b7aa395e342a => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:21.625001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:21.626855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.636218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-d3c1fe1b-a9e3-426b-908e-f67dee9e7b40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e99b5ff345464faa9634db4389f3f7'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.646417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1014/2020] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:21 2022] DELETE /identity/v3/users/f6e99b5ff345464faa9634db4389f3f7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:21.647522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2aa88-5229-4e51-b678-898c35fac7d4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:21.647802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2aa88-5229-4e51-b678-898c35fac7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:21.648080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a2aa88-5229-4e51-b678-898c35fac7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:21.670852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c7a2aa88-5229-4e51-b678-898c35fac7d4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:21.672799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c7a2aa88-5229-4e51-b678-898c35fac7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.707710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37e0a4-18c4-41c0-a011-bd26978f5e2e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:21.734905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:21.752575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1015/2021] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:21.754514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8fe3b-e8fa-4f31-a12f-9c04d5d4df5a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:21.754887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8fe3b-e8fa-4f31-a12f-9c04d5d4df5a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:21.755163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8fe3b-e8fa-4f31-a12f-9c04d5d4df5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:21.774506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:21.775082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-54d8fe3b-e8fa-4f31-a12f-9c04d5d4df5a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:21.775299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:21.775587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:21.775972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] PATH_INFO: `/v3/projects/8e1b0dbd43b94201bdad8ed394fc60d8` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:21.776609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-54d8fe3b-e8fa-4f31-a12f-9c04d5d4df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.777349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e1b0dbd43b94201bdad8ed394fc60d8)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:21.779431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:21.785121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1016/2022] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:21.785936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8fe3b-e8fa-4f31-a12f-9c04d5d4df5a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:21.787549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-54d8fe3b-e8fa-4f31-a12f-9c04d5d4df5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.829992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e1b0dbd43b94201bdad8ed394fc60d8', 'request_id': 'req-53fd42bf-3837-458e-8780-64eff7421a73'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.837451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e1b0dbd43b94201bdad8ed394fc60d8', 'request_id': 'req-53fd42bf-3837-458e-8780-64eff7421a73'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.846786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e1b0dbd43b94201bdad8ed394fc60d8', 'request_id': 'req-53fd42bf-3837-458e-8780-64eff7421a73'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.853242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8fe3b-e8fa-4f31-a12f-9c04d5d4df5a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:21.860204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] The token cache is being invalidate because project 8e1b0dbd43b94201bdad8ed394fc60d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:21.860585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.861327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:21.862806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1007/2023] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:21 2022] DELETE /identity/v3/projects/8e1b0dbd43b94201bdad8ed394fc60d8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:21.866851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:21.868222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.902665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:21.907857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beced2e-cc4b-4492-b48f-50f12d4ce7b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:21.908888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beced2e-cc4b-4492-b48f-50f12d4ce7b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:21.909276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beced2e-cc4b-4492-b48f-50f12d4ce7b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:21.909582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beced2e-cc4b-4492-b48f-50f12d4ce7b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:21.912334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0beced2e-cc4b-4492-b48f-50f12d4ce7b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.931700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fd42bf-3837-458e-8780-64eff7421a73 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:21.936052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d357e05a-b5f1-48b8-9725-4c159997980d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:21.936874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e05a-b5f1-48b8-9725-4c159997980d service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:21.936994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e05a-b5f1-48b8-9725-4c159997980d service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:21.937261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d357e05a-b5f1-48b8-9725-4c159997980d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:21.939182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d357e05a-b5f1-48b8-9725-4c159997980d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:21.995066 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beced2e-cc4b-4492-b48f-50f12d4ce7b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:21.996530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beced2e-cc4b-4492-b48f-50f12d4ce7b5 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.007318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1017/2024] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:22.008562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6be0-dfe7-4db0-ab27-82ace07c8d36 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.008852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6be0-dfe7-4db0-ab27-82ace07c8d36 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.009188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6be0-dfe7-4db0-ab27-82ace07c8d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.012246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357e05a-b5f1-48b8-9725-4c159997980d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.013699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d357e05a-b5f1-48b8-9725-4c159997980d service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.026219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1008/2025] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:22.028769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-667c6be0-dfe7-4db0-ab27-82ace07c8d36 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:22.030229 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-667c6be0-dfe7-4db0-ab27-82ace07c8d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:22.046908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1018/2026] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:22.049283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eaac7-7c5f-4e48-8667-a82a367592fc None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.049682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eaac7-7c5f-4e48-8667-a82a367592fc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.050057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6eaac7-7c5f-4e48-8667-a82a367592fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.067479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:22.080843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5f6eaac7-7c5f-4e48-8667-a82a367592fc None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:22.084986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5f6eaac7-7c5f-4e48-8667-a82a367592fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:22.097635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1009/2027] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:22.099737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6be0-dfe7-4db0-ab27-82ace07c8d36 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:22.112364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6be0-dfe7-4db0-ab27-82ace07c8d36 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:22.118072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:22.118847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.119236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.119749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.120645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:22.121028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.122763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.140678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1019/2028] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:22.142205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eaac7-7c5f-4e48-8667-a82a367592fc None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:22.155287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6eaac7-7c5f-4e48-8667-a82a367592fc None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:22.160063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:22.161812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.162181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.162643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.163388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.165469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.225339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1010/2029] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:22 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:22.229126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:22.261579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18494c2-0a1d-4640-b94c-eb5c1e00317a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:22.401439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818485b-b35a-4ccc-b8a8-0d7361624d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:22.402235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818485b-b35a-4ccc-b8a8-0d7361624d1d admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.402597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818485b-b35a-4ccc-b8a8-0d7361624d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.402947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c818485b-b35a-4ccc-b8a8-0d7361624d1d admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.403670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818485b-b35a-4ccc-b8a8-0d7361624d1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.407474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c818485b-b35a-4ccc-b8a8-0d7361624d1d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.434377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:22.436567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:22.470095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1020/2030] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:22 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:22.473983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818485b-b35a-4ccc-b8a8-0d7361624d1d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:22.483338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574935f-353d-4391-bd1b-72c20e221d60 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:22.503599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:22.505766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.506403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.506860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] PATH_INFO: `/v3/projects/223c92029dc7458487586ecfc542b710` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.508417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=223c92029dc7458487586ecfc542b710)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.513740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.514105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c818485b-b35a-4ccc-b8a8-0d7361624d1d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:22.529328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317a358-9424-48e2-b64e-beab168c3b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:22.530384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a358-9424-48e2-b64e-beab168c3b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.530878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a358-9424-48e2-b64e-beab168c3b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.531655 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317a358-9424-48e2-b64e-beab168c3b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.533561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317a358-9424-48e2-b64e-beab168c3b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.535812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317a358-9424-48e2-b64e-beab168c3b22 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.571345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1021/2031] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:22.576228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317a358-9424-48e2-b64e-beab168c3b22 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:22.597741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223c92029dc7458487586ecfc542b710', 'request_id': 'req-b5765332-70c7-42db-90cd-5a5c514ad75f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.614620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223c92029dc7458487586ecfc542b710', 'request_id': 'req-b5765332-70c7-42db-90cd-5a5c514ad75f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.618163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317a358-9424-48e2-b64e-beab168c3b22 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:22.635733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223c92029dc7458487586ecfc542b710', 'request_id': 'req-b5765332-70c7-42db-90cd-5a5c514ad75f'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.660253 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] The token cache is being invalidate because project 223c92029dc7458487586ecfc542b710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:22.660538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.661351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.663469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1011/2032] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:22 2022] DELETE /identity/v3/projects/223c92029dc7458487586ecfc542b710 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:22.667969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:22.671477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:22.782948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:22.800181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:22.801660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.802712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.803148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.803956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.806119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.819497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1022/2033] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:22 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:22.820528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:22.822681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:22.840164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80c4488-f98d-47fa-bd19-62535398b1f7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:22.849834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:22.850843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.850987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5765332-70c7-42db-90cd-5a5c514ad75f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:22.851334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.851751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] PATH_INFO: `/v3/users/3c72e8ae61c54c6787318ddb92aec808` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.853618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c72e8ae61c54c6787318ddb92aec808)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.855816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.856931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:22.857690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:22.858111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:22.861350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] PATH_INFO: `/v3/projects/8a773355241c4fc7a17b32da489c147b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:22.866521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a773355241c4fc7a17b32da489c147b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:22.869316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:22.964724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c72e8ae61c54c6787318ddb92aec808'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.966714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c72e8ae61c54c6787318ddb92aec808'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.986822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a773355241c4fc7a17b32da489c147b', 'request_id': 'req-384f8165-2c65-4c25-825d-6dae565b70b9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.986972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c72e8ae61c54c6787318ddb92aec808'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.996668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a773355241c4fc7a17b32da489c147b', 'request_id': 'req-384f8165-2c65-4c25-825d-6dae565b70b9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:22.997450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c72e8ae61c54c6787318ddb92aec808'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.011301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a773355241c4fc7a17b32da489c147b', 'request_id': 'req-384f8165-2c65-4c25-825d-6dae565b70b9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.013280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c72e8ae61c54c6787318ddb92aec808'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.015419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:DELETE=13 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:23.025618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1023/2034] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:22 2022] DELETE /identity/v3/users/3c72e8ae61c54c6787318ddb92aec808 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:23.026730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.028087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.031573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] The token cache is being invalidate because project 8a773355241c4fc7a17b32da489c147b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:23.032058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.032875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.035100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1012/2035] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:22 2022] DELETE /identity/v3/projects/8a773355241c4fc7a17b32da489c147b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:23.039122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.040834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.117579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f55c3-a5b4-4417-b962-ed3ccb956716 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.127790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b4fe5-2ce3-433f-9d7d-eab05260a49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.128493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b4fe5-2ce3-433f-9d7d-eab05260a49b admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.129735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b4fe5-2ce3-433f-9d7d-eab05260a49b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.130148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b4fe5-2ce3-433f-9d7d-eab05260a49b admin admin] PATH_INFO: `/v3/projects/6181020786e54fec828a1e3d3b0b3d6e/users/71dc5db8bf4449b1901670581c996eef/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.148974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f8165-2c65-4c25-825d-6dae565b70b9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.153797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b4fe5-2ce3-433f-9d7d-eab05260a49b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6181020786e54fec828a1e3d3b0b3d6e, user_id=71dc5db8bf4449b1901670581c996eef, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.154275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.154921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.155263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.155978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] PATH_INFO: `/v3/users/1fa87aa1ca254d4b84777d948eb9c971` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.156703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b4fe5-2ce3-433f-9d7d-eab05260a49b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:23.156808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa87aa1ca254d4b84777d948eb9c971)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.158755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:23.172947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1024/2036] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:23 2022] PUT /identity/v3/projects/6181020786e54fec828a1e3d3b0b3d6e/users/71dc5db8bf4449b1901670581c996eef/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:23.184237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68765-953a-412b-b5a1-062f7c2c206f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.184606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68765-953a-412b-b5a1-062f7c2c206f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.184994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab68765-953a-412b-b5a1-062f7c2c206f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.228936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3ab68765-953a-412b-b5a1-062f7c2c206f None None] MFA Rules not processed for user `71dc5db8bf4449b1901670581c996eef`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:23.231290 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3ab68765-953a-412b-b5a1-062f7c2c206f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.241048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa87aa1ca254d4b84777d948eb9c971'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.267362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa87aa1ca254d4b84777d948eb9c971'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.268195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa87aa1ca254d4b84777d948eb9c971'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.280421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa87aa1ca254d4b84777d948eb9c971'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.294854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa87aa1ca254d4b84777d948eb9c971'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.303516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1013/2037] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:23 2022] DELETE /identity/v3/users/1fa87aa1ca254d4b84777d948eb9c971 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:23.330138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:23.380671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1025/2038] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:23.385265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.386861 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.466594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd56755a-75d4-461d-9702-cdc6cc8a6ea9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.471834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.472511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.472800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.473096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.473723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.475772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:23.493079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:23.513938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1014/2039] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:23 2022] POST /identity/v3/projects => generated 385 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:23.515158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68765-953a-412b-b5a1-062f7c2c206f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.576547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.578743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.657639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab68765-953a-412b-b5a1-062f7c2c206f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.679012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3084c3-36c1-4663-8059-e0a44f159236 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.692620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.693514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.693768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.694186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] PATH_INFO: `/v3/projects/59971780246c45e49bbe4b23c5cda9bb` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.695714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59971780246c45e49bbe4b23c5cda9bb)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.697910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:23.782103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59971780246c45e49bbe4b23c5cda9bb', 'request_id': 'req-91c65108-745a-40e0-a02d-0c31e3358ab4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.792397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59971780246c45e49bbe4b23c5cda9bb', 'request_id': 'req-91c65108-745a-40e0-a02d-0c31e3358ab4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.793578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.794453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.795022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.795542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.796509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.798915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:23.803782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59971780246c45e49bbe4b23c5cda9bb', 'request_id': 'req-91c65108-745a-40e0-a02d-0c31e3358ab4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.824019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] The token cache is being invalidate because project 59971780246c45e49bbe4b23c5cda9bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:23.824448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.826185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-91c65108-745a-40e0-a02d-0c31e3358ab4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:23.827096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1026/2040] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:23 2022] POST /identity/v3/users => generated 299 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:23.827847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.828539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1015/2041] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:23 2022] DELETE /identity/v3/projects/59971780246c45e49bbe4b23c5cda9bb => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:23.830077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.835279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d45e-60c5-48f0-a638-375d13d1ef5a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.835713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d45e-60c5-48f0-a638-375d13d1ef5a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.836231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d45e-60c5-48f0-a638-375d13d1ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.846679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3995726-3034-4eba-beec-d020cab47fe5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.860890 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2a38d45e-60c5-48f0-a638-375d13d1ef5a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:23.862757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2a38d45e-60c5-48f0-a638-375d13d1ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.934811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.935466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.935881 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.936170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] PATH_INFO: `/v3/projects/78f3819770204e08b7173ec4a75ddf54` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.937409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78f3819770204e08b7173ec4a75ddf54)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.939585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:23.940490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1016/2042] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:23.942654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d45e-60c5-48f0-a638-375d13d1ef5a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:23.951005 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2a38d45e-60c5-48f0-a638-375d13d1ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:23.959651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:23.975365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d45e-60c5-48f0-a638-375d13d1ef5a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:23.990465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de140ae2-3251-42c4-b387-5d394ea80fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:23.993242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140ae2-3251-42c4-b387-5d394ea80fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:23.993547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140ae2-3251-42c4-b387-5d394ea80fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:23.993843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de140ae2-3251-42c4-b387-5d394ea80fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:23.994620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de140ae2-3251-42c4-b387-5d394ea80fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:23.996320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de140ae2-3251-42c4-b387-5d394ea80fe5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.013295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1017/2043] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:24.016975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758182-6ccf-42eb-94a1-99ebb1ef4acd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.016975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758182-6ccf-42eb-94a1-99ebb1ef4acd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.016975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec758182-6ccf-42eb-94a1-99ebb1ef4acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.020624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78f3819770204e08b7173ec4a75ddf54', 'request_id': 'req-bde63935-29c8-4fdd-abc9-261604fb1a10'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.037093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78f3819770204e08b7173ec4a75ddf54', 'request_id': 'req-bde63935-29c8-4fdd-abc9-261604fb1a10'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.054167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78f3819770204e08b7173ec4a75ddf54', 'request_id': 'req-bde63935-29c8-4fdd-abc9-261604fb1a10'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.070266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ec758182-6ccf-42eb-94a1-99ebb1ef4acd None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:24.071762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ec758182-6ccf-42eb-94a1-99ebb1ef4acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.075924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] The token cache is being invalidate because project 78f3819770204e08b7173ec4a75ddf54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:24.076350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.078294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.087208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1027/2044] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:23 2022] DELETE /identity/v3/projects/78f3819770204e08b7173ec4a75ddf54 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:24.087208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.091607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.092837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.161437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1018/2045] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:24.162882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae84c05-3376-46d0-8519-15410e62513c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.163243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae84c05-3376-46d0-8519-15410e62513c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.163586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae84c05-3376-46d0-8519-15410e62513c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.190799 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1ae84c05-3376-46d0-8519-15410e62513c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:24.192605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1ae84c05-3376-46d0-8519-15410e62513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.202338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1019/2046] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:24.203227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae84c05-3376-46d0-8519-15410e62513c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.205191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1ae84c05-3376-46d0-8519-15410e62513c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.219551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae84c05-3376-46d0-8519-15410e62513c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.226066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.226834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.227213 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.227707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] PATH_INFO: `/v3/users/a4dc2fc081e14aa4a20bcc35a55cac42` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.228951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4dc2fc081e14aa4a20bcc35a55cac42)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.231623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.244132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde63935-29c8-4fdd-abc9-261604fb1a10 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.262772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890697-1ced-4b54-ae94-1ed816e94eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.264264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890697-1ced-4b54-ae94-1ed816e94eea admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.264769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890697-1ced-4b54-ae94-1ed816e94eea admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.265259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e890697-1ced-4b54-ae94-1ed816e94eea admin admin] PATH_INFO: `/v3/projects/e7fcf893a20f4a3e95d0e640c3cda95c/users/c112c37db9b54c8b80e5f2f0f333430b/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.300261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e890697-1ced-4b54-ae94-1ed816e94eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fcf893a20f4a3e95d0e640c3cda95c, user_id=c112c37db9b54c8b80e5f2f0f333430b, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.308915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e890697-1ced-4b54-ae94-1ed816e94eea admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.318978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4dc2fc081e14aa4a20bcc35a55cac42'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.331094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1028/2047] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:24 2022] PUT /identity/v3/projects/e7fcf893a20f4a3e95d0e640c3cda95c/users/c112c37db9b54c8b80e5f2f0f333430b/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:24.333424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890697-1ced-4b54-ae94-1ed816e94eea admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.336751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4dc2fc081e14aa4a20bcc35a55cac42'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.337972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4dc2fc081e14aa4a20bcc35a55cac42'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.353334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4dc2fc081e14aa4a20bcc35a55cac42'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.370911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-505ebb23-22c1-4109-ab14-18534c159b9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4dc2fc081e14aa4a20bcc35a55cac42'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:24.382892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1020/2048] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:24 2022] DELETE /identity/v3/users/a4dc2fc081e14aa4a20bcc35a55cac42 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:24.387298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d837c-f288-4744-a99c-d3aa35bc83db None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.387585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d837c-f288-4744-a99c-d3aa35bc83db None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.387876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740d837c-f288-4744-a99c-d3aa35bc83db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.432180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e890697-1ced-4b54-ae94-1ed816e94eea admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.432396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-740d837c-f288-4744-a99c-d3aa35bc83db None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:24.432396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-740d837c-f288-4744-a99c-d3aa35bc83db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.483304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.521749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.522464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.522851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.523172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.523944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:24.524306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.526274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.543101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1029/2049] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:24.544349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.546981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.567017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187f84a1-0f21-4c39-b3dd-1fcc18af62fb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.578534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.583001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.584574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.586148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.588871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.591868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.615233 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1021/2050] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:24.617216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fec81f-12f3-4538-b491-7fa62e64f625 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.617522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fec81f-12f3-4538-b491-7fa62e64f625 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.617797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fec81f-12f3-4538-b491-7fa62e64f625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.642239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1030/2051] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:24.643111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.647928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.658852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-14fec81f-12f3-4538-b491-7fa62e64f625 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:24.661336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-14fec81f-12f3-4538-b491-7fa62e64f625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.672760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1022/2052] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:24.673966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fec81f-12f3-4538-b491-7fa62e64f625 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.674104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f26b384-9dca-4c67-9e9b-cab241bdcf54 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.696030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.696030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.696030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.696635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.697427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.698084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fec81f-12f3-4538-b491-7fa62e64f625 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.700012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.715244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.715244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.715581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.715821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.719663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:24.719939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.724172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.761843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1023/2053] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:24.769024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.773454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1031/2054] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:24.776773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.776773 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:24.794889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:24.805417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036e670-6a89-4427-a44d-6b0e03a6a455 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.846625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a9e5-e154-43e6-924e-b37317741260 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:24.850993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858ca2-3c8a-4773-9a1e-e7ebd6fececa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.851615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858ca2-3c8a-4773-9a1e-e7ebd6fececa service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.851888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858ca2-3c8a-4773-9a1e-e7ebd6fececa service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.852304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a858ca2-3c8a-4773-9a1e-e7ebd6fececa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.894215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ffb76-4717-4acd-83ee-88b5ea5b2a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:24.896767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ffb76-4717-4acd-83ee-88b5ea5b2a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:24.897161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ffb76-4717-4acd-83ee-88b5ea5b2a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:24.897463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ffb76-4717-4acd-83ee-88b5ea5b2a9f admin admin] PATH_INFO: `/v3/projects/e7fcf893a20f4a3e95d0e640c3cda95c/users/c112c37db9b54c8b80e5f2f0f333430b/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:24.902442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ffb76-4717-4acd-83ee-88b5ea5b2a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7fcf893a20f4a3e95d0e640c3cda95c, user_id=c112c37db9b54c8b80e5f2f0f333430b, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.905140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7ffb76-4717-4acd-83ee-88b5ea5b2a9f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.929946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1024/2055] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:24 2022] PUT /identity/v3/projects/e7fcf893a20f4a3e95d0e640c3cda95c/users/c112c37db9b54c8b80e5f2f0f333430b/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:24.929946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ffb76-4717-4acd-83ee-88b5ea5b2a9f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.949653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858ca2-3c8a-4773-9a1e-e7ebd6fececa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:24.951509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a858ca2-3c8a-4773-9a1e-e7ebd6fececa service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:24.963836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1032/2056] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:24.965153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858ca2-3c8a-4773-9a1e-e7ebd6fececa service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:24.977471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a858ca2-3c8a-4773-9a1e-e7ebd6fececa service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.039493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:25.048200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7ffb76-4717-4acd-83ee-88b5ea5b2a9f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.054943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a893f1de-9daf-4492-931f-05ebcf1354d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.055343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53983664-a997-4011-bcf7-18e0934841a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.055940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f1de-9daf-4492-931f-05ebcf1354d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.056473 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53983664-a997-4011-bcf7-18e0934841a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.056741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f1de-9daf-4492-931f-05ebcf1354d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.057019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a893f1de-9daf-4492-931f-05ebcf1354d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.057493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53983664-a997-4011-bcf7-18e0934841a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.057856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53983664-a997-4011-bcf7-18e0934841a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.058103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f1de-9daf-4492-931f-05ebcf1354d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.058746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53983664-a997-4011-bcf7-18e0934841a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.060810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a893f1de-9daf-4492-931f-05ebcf1354d5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.061100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53983664-a997-4011-bcf7-18e0934841a9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.096472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1033/2057] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:25.096694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994772b3-bf8c-4e8d-a279-cb14ded46293 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.097049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994772b3-bf8c-4e8d-a279-cb14ded46293 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.097924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994772b3-bf8c-4e8d-a279-cb14ded46293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.118334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1025/2058] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:24 2022] POST /identity/v3/projects => generated 373 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:25.119693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53983664-a997-4011-bcf7-18e0934841a9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.139474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-994772b3-bf8c-4e8d-a279-cb14ded46293 None None] MFA Rules not processed for user `c112c37db9b54c8b80e5f2f0f333430b`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:25.140843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-994772b3-bf8c-4e8d-a279-cb14ded46293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:25.225399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53983664-a997-4011-bcf7-18e0934841a9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.230497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8545a9-be9a-4d15-ae16-f60a2a04bbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.231122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8545a9-be9a-4d15-ae16-f60a2a04bbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.231461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8545a9-be9a-4d15-ae16-f60a2a04bbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.231744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8545a9-be9a-4d15-ae16-f60a2a04bbd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.232683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8545a9-be9a-4d15-ae16-f60a2a04bbd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.234583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8545a9-be9a-4d15-ae16-f60a2a04bbd5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.250332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1026/2059] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:25.251237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8545a9-be9a-4d15-ae16-f60a2a04bbd5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.268246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1034/2060] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:25 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:25.268823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8545a9-be9a-4d15-ae16-f60a2a04bbd5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.269168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994772b3-bf8c-4e8d-a279-cb14ded46293 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.275039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a78dfa-7e19-47ae-bc95-c7f2be2d8e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.275745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78dfa-7e19-47ae-bc95-c7f2be2d8e18 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.276365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78dfa-7e19-47ae-bc95-c7f2be2d8e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.276747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a78dfa-7e19-47ae-bc95-c7f2be2d8e18 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.277810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a78dfa-7e19-47ae-bc95-c7f2be2d8e18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.280249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a78dfa-7e19-47ae-bc95-c7f2be2d8e18 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.283929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994772b3-bf8c-4e8d-a279-cb14ded46293 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.290627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.291436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.291862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.292286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.293101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.295964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.316211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1035/2061] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:25.316420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:25.318514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.321195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1027/2062] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:25 2022] POST /identity/v3/users => generated 287 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:25.321412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:25.326271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a78dfa-7e19-47ae-bc95-c7f2be2d8e18 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.354886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a78dfa-7e19-47ae-bc95-c7f2be2d8e18 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.368726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed6ae6-17a7-4694-b3ad-9179a2756c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.369796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed6ae6-17a7-4694-b3ad-9179a2756c01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.370697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed6ae6-17a7-4694-b3ad-9179a2756c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.370808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ed6ae6-17a7-4694-b3ad-9179a2756c01 admin admin] PATH_INFO: `/v3/projects/a396390c57754b4f804369a25e42eb00/users/9c30bc30378a4818879e1ca0db4952ff/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.396157 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed6ae6-17a7-4694-b3ad-9179a2756c01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a396390c57754b4f804369a25e42eb00, user_id=9c30bc30378a4818879e1ca0db4952ff, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.400156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ed6ae6-17a7-4694-b3ad-9179a2756c01 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.421390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b139276-61b1-4321-bcb5-0bb4d15a38ba admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.426853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1028/2063] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:25 2022] PUT /identity/v3/projects/a396390c57754b4f804369a25e42eb00/users/9c30bc30378a4818879e1ca0db4952ff/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:25.426853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed6ae6-17a7-4694-b3ad-9179a2756c01 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.522561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6939aa-da20-4efd-b8f0-cbd7264e8d8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.523121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6939aa-da20-4efd-b8f0-cbd7264e8d8d service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.523406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6939aa-da20-4efd-b8f0-cbd7264e8d8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.523683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6939aa-da20-4efd-b8f0-cbd7264e8d8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.525603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bd6939aa-da20-4efd-b8f0-cbd7264e8d8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:25.544983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ed6ae6-17a7-4694-b3ad-9179a2756c01 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.551232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.552025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.552869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.553256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.554064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.556155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.559491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:25.569794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1029/2064] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:25.573724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.575936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:25.591627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f85e31-9133-428f-ac1c-44c81c43b3e3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.601440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.602143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.602437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.602695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] PATH_INFO: `/v3/projects/36330a8840754782b40bd383e34795fa` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.604117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36330a8840754782b40bd383e34795fa)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.605843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.618287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6939aa-da20-4efd-b8f0-cbd7264e8d8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.620571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6939aa-da20-4efd-b8f0-cbd7264e8d8d service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.639856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1036/2065] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:25.643567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd6efc-1224-4667-8228-0ac2e0f0963b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.643982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd6efc-1224-4667-8228-0ac2e0f0963b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.644802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fd6efc-1224-4667-8228-0ac2e0f0963b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.674442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36330a8840754782b40bd383e34795fa', 'request_id': 'req-02260f10-268a-4cb9-906b-4b30650dad80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:25.681554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e0fd6efc-1224-4667-8228-0ac2e0f0963b None None] MFA Rules not processed for user `9c30bc30378a4818879e1ca0db4952ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:25.682843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e0fd6efc-1224-4667-8228-0ac2e0f0963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:25.684849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36330a8840754782b40bd383e34795fa', 'request_id': 'req-02260f10-268a-4cb9-906b-4b30650dad80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:25.706501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36330a8840754782b40bd383e34795fa', 'request_id': 'req-02260f10-268a-4cb9-906b-4b30650dad80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:25.723802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] The token cache is being invalidate because project 36330a8840754782b40bd383e34795fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:25.724183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:25.724941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:25.726668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1030/2066] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:25 2022] DELETE /identity/v3/projects/36330a8840754782b40bd383e34795fa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:25.730735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.732576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:25.772337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1037/2067] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:25.773166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd6efc-1224-4667-8228-0ac2e0f0963b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.776808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e0fd6efc-1224-4667-8228-0ac2e0f0963b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:25.818521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:25.824116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02260f10-268a-4cb9-906b-4b30650dad80 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.833242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.834300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.834767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.835159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.835927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.837586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.850158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1031/2068] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:25 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:25.854458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.859748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:25.880042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79932a7-cecf-4792-b5bf-a7854667f759 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.889586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828768c2-6050-47ba-bb6b-e7297b81fa9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.891568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828768c2-6050-47ba-bb6b-e7297b81fa9c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.892088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828768c2-6050-47ba-bb6b-e7297b81fa9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.892776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828768c2-6050-47ba-bb6b-e7297b81fa9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.894826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828768c2-6050-47ba-bb6b-e7297b81fa9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.897451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828768c2-6050-47ba-bb6b-e7297b81fa9c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:25.931865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fd6efc-1224-4667-8228-0ac2e0f0963b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:25.948255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:25.949831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:25.949831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:25.950299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] PATH_INFO: `/v3/users/b155c6881c624366890e115faea53264` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:25.950924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1032/2069] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:25 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:25.952353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828768c2-6050-47ba-bb6b-e7297b81fa9c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:25.952489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b155c6881c624366890e115faea53264)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:25.955277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:26.034483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b155c6881c624366890e115faea53264'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:26.038104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b155c6881c624366890e115faea53264'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:26.044615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:26.054095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b155c6881c624366890e115faea53264'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:26.071410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b155c6881c624366890e115faea53264'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:26.091690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828768c2-6050-47ba-bb6b-e7297b81fa9c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:26.105455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4a920-cebf-4559-a4cf-f5c1548dcc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:26.106444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a920-cebf-4559-a4cf-f5c1548dcc50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.108259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a920-cebf-4559-a4cf-f5c1548dcc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.109145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b155c6881c624366890e115faea53264'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:26.109604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4a920-cebf-4559-a4cf-f5c1548dcc50 admin admin] PATH_INFO: `/v3/projects/5221ada8d9bb48f8914d88ef022a7da9/users/534209fcaed54170af7c2e8e1f284987/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.139752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1038/2070] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:25 2022] DELETE /identity/v3/users/b155c6881c624366890e115faea53264 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:26.141410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4a920-cebf-4559-a4cf-f5c1548dcc50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5221ada8d9bb48f8914d88ef022a7da9, user_id=534209fcaed54170af7c2e8e1f284987, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:26.142867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:26.144437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:26.146083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4a920-cebf-4559-a4cf-f5c1548dcc50 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:26.172644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1033/2071] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:25 2022] PUT /identity/v3/projects/5221ada8d9bb48f8914d88ef022a7da9/users/534209fcaed54170af7c2e8e1f284987/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:26.187188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73dd4e-b4d1-4b9d-b9be-54cc063c361e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.187796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73dd4e-b4d1-4b9d-b9be-54cc063c361e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.188263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73dd4e-b4d1-4b9d-b9be-54cc063c361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.277262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1c73dd4e-b4d1-4b9d-b9be-54cc063c361e None None] MFA Rules not processed for user `534209fcaed54170af7c2e8e1f284987`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:26.278872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1c73dd4e-b4d1-4b9d-b9be-54cc063c361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:26.362300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b11802-6e43-4366-9a49-1c9eca37339a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:26.440047 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1034/2072] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:26.447692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73dd4e-b4d1-4b9d-b9be-54cc063c361e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:26.449320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1c73dd4e-b4d1-4b9d-b9be-54cc063c361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:26.455081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8debf-cfa8-43fe-a5ed-c32df11e5490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:26.455826 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8debf-cfa8-43fe-a5ed-c32df11e5490 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.456334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8debf-cfa8-43fe-a5ed-c32df11e5490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.457231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8debf-cfa8-43fe-a5ed-c32df11e5490 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.461763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8debf-cfa8-43fe-a5ed-c32df11e5490 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:26.463937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8debf-cfa8-43fe-a5ed-c32df11e5490 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:26.494834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1039/2073] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:26 2022] POST /identity/v3/users => generated 296 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:26.499762 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8debf-cfa8-43fe-a5ed-c32df11e5490 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:26.511274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8debf-cfa8-43fe-a5ed-c32df11e5490 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:26.517516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761aec8-768e-4ed4-b470-453a5580c8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:26.518110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761aec8-768e-4ed4-b470-453a5580c8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.518526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761aec8-768e-4ed4-b470-453a5580c8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.519742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761aec8-768e-4ed4-b470-453a5580c8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.521000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761aec8-768e-4ed4-b470-453a5580c8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:26.522765 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761aec8-768e-4ed4-b470-453a5580c8f0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:26.529295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:26.541639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1040/2074] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:26.542588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761aec8-768e-4ed4-b470-453a5580c8f0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:26.553691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73dd4e-b4d1-4b9d-b9be-54cc063c361e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:26.554497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761aec8-768e-4ed4-b470-453a5580c8f0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:26.563559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:26.564740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.565028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.565304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] PATH_INFO: `/v3/projects/17eeda71a1b744c3a3a894ce7dccbc81/users/8899bfa9265b4a12800dae08676cd121/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.569811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6db36-2adb-47cb-a1c6-cb8a8acd009f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:26.569811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6db36-2adb-47cb-a1c6-cb8a8acd009f service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.570084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6db36-2adb-47cb-a1c6-cb8a8acd009f service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.576241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6db36-2adb-47cb-a1c6-cb8a8acd009f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.588772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6db36-2adb-47cb-a1c6-cb8a8acd009f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:26.590324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f6db36-2adb-47cb-a1c6-cb8a8acd009f service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:26.594779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17eeda71a1b744c3a3a894ce7dccbc81, user_id=8899bfa9265b4a12800dae08676cd121, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:26.598693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:26.601539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1035/2075] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:26.622527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1041/2076] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:26 2022] PUT /identity/v3/projects/17eeda71a1b744c3a3a894ce7dccbc81/users/8899bfa9265b4a12800dae08676cd121/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:26.627154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6db36-2adb-47cb-a1c6-cb8a8acd009f service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:26.639469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6db36-2adb-47cb-a1c6-cb8a8acd009f service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:26.745811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:26.747908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:26.785776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d449e0-331e-49f5-8f62-c13984621de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:26.785776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d449e0-331e-49f5-8f62-c13984621de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.785776 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d449e0-331e-49f5-8f62-c13984621de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.787095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d449e0-331e-49f5-8f62-c13984621de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.787095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d449e0-331e-49f5-8f62-c13984621de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:26.789621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d449e0-331e-49f5-8f62-c13984621de4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:26.810418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1036/2077] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:26.817606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d449e0-331e-49f5-8f62-c13984621de4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:26.822895 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:26.847069 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d449e0-331e-49f5-8f62-c13984621de4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:26.854651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a25ef-ea78-4718-bc8e-dbc4f35e8fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:26.856517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a25ef-ea78-4718-bc8e-dbc4f35e8fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.856517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a25ef-ea78-4718-bc8e-dbc4f35e8fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.856517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a25ef-ea78-4718-bc8e-dbc4f35e8fa3 admin admin] PATH_INFO: `/v3/projects/17eeda71a1b744c3a3a894ce7dccbc81/users/8899bfa9265b4a12800dae08676cd121/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.858614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a25ef-ea78-4718-bc8e-dbc4f35e8fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17eeda71a1b744c3a3a894ce7dccbc81, user_id=8899bfa9265b4a12800dae08676cd121, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:26.861488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a25ef-ea78-4718-bc8e-dbc4f35e8fa3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:26.876406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1037/2078] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:26 2022] PUT /identity/v3/projects/17eeda71a1b744c3a3a894ce7dccbc81/users/8899bfa9265b4a12800dae08676cd121/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:26.883197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f3dd8-2de8-476e-acbe-14556c2ecd26 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:26.887299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74677-e2f6-486e-bca7-3f636730a7b9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:26.887662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74677-e2f6-486e-bca7-3f636730a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:26.888039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d74677-e2f6-486e-bca7-3f636730a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:26.931428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c5d74677-e2f6-486e-bca7-3f636730a7b9 None None] MFA Rules not processed for user `8899bfa9265b4a12800dae08676cd121`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:26.932857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c5d74677-e2f6-486e-bca7-3f636730a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:27.015886 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:27.016763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:27.017869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:27.017869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] PATH_INFO: `/v3/projects/5a84c6d450534556a3d2adc59ffa2b7a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:27.019022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a84c6d450534556a3d2adc59ffa2b7a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:27.022182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:27.104466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a84c6d450534556a3d2adc59ffa2b7a', 'request_id': 'req-2588a65f-b5a8-49dd-b011-3559d0da478d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.114759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a84c6d450534556a3d2adc59ffa2b7a', 'request_id': 'req-2588a65f-b5a8-49dd-b011-3559d0da478d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.137081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a84c6d450534556a3d2adc59ffa2b7a', 'request_id': 'req-2588a65f-b5a8-49dd-b011-3559d0da478d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.152108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] The token cache is being invalidate because project 5a84c6d450534556a3d2adc59ffa2b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:27.152405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.153117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.155253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1042/2079] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:26 2022] DELETE /identity/v3/projects/5a84c6d450534556a3d2adc59ffa2b7a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:27.158676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:27.160263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1038/2080] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:26 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:27.160933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:27.169036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74677-e2f6-486e-bca7-3f636730a7b9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:27.247641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d74677-e2f6-486e-bca7-3f636730a7b9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:27.253125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:27.272166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a65f-b5a8-49dd-b011-3559d0da478d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:27.280602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:27.282118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:27.282592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:27.282927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] PATH_INFO: `/v3/users/d6dda6c137ba42779568ef8f26d7f0bd` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:27.284628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6dda6c137ba42779568ef8f26d7f0bd)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:27.287407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:27.302586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:27.328522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:27.329558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:27.330121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:27.330624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:27.334391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:27.383582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6dda6c137ba42779568ef8f26d7f0bd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.386493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6dda6c137ba42779568ef8f26d7f0bd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.401728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6dda6c137ba42779568ef8f26d7f0bd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.423596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6dda6c137ba42779568ef8f26d7f0bd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.449502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6dda6c137ba42779568ef8f26d7f0bd'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:27.458521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1043/2081] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:27 2022] DELETE /identity/v3/users/d6dda6c137ba42779568ef8f26d7f0bd => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:27.462285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:27.463699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:27.482328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1039/2082] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:27 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:27.864166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:27.866100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:28.008412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f003bb-689b-48fb-a621-241907759381 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.037730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.038578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.038676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.038954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] PATH_INFO: `/v3/projects/9c3b87ee538b4199b024fb456392b4a5` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.041343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c3b87ee538b4199b024fb456392b4a5)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.057658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.114991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.134267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6e058-3598-4e71-b485-9bee49807e80 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.147944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c3b87ee538b4199b024fb456392b4a5', 'request_id': 'req-49707267-afea-4b0f-959e-29d3bb50ecee'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.168612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c3b87ee538b4199b024fb456392b4a5', 'request_id': 'req-49707267-afea-4b0f-959e-29d3bb50ecee'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.194457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c3b87ee538b4199b024fb456392b4a5', 'request_id': 'req-49707267-afea-4b0f-959e-29d3bb50ecee'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.230664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] The token cache is being invalidate because project 9c3b87ee538b4199b024fb456392b4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:28.230966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.232232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-49707267-afea-4b0f-959e-29d3bb50ecee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.237471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1044/2083] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:27 2022] DELETE /identity/v3/projects/9c3b87ee538b4199b024fb456392b4a5 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:28.243029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40329-5167-40f4-9155-dba84393678a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.243302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40329-5167-40f4-9155-dba84393678a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.243585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c40329-5167-40f4-9155-dba84393678a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.273720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8899bfa9265b4a12800dae08676cd121', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17eeda71a1b744c3a3a894ce7dccbc81', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.274443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.274721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.279868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.280597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:28.281075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.283536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.301293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-52c40329-5167-40f4-9155-dba84393678a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:28.301293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-52c40329-5167-40f4-9155-dba84393678a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:28.301480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1040/2084] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:28.305289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.307329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:28.329904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aea735-30a7-4415-9d21-2b9043403330 tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.334165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.347027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba0b2-078a-456b-ad36-cefe936020bb tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8899bfa9265b4a12800dae08676cd121', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17eeda71a1b744c3a3a894ce7dccbc81', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.348865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba0b2-078a-456b-ad36-cefe936020bb tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.349682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba0b2-078a-456b-ad36-cefe936020bb tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.350203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ba0b2-078a-456b-ad36-cefe936020bb tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.351326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ba0b2-078a-456b-ad36-cefe936020bb tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.383145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ba0b2-078a-456b-ad36-cefe936020bb tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.410868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1045/2085] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:28.419528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849043f-2cf9-4633-ba07-c18f3d2b879c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.419810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849043f-2cf9-4633-ba07-c18f3d2b879c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.420083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849043f-2cf9-4633-ba07-c18f3d2b879c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.433996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1041/2086] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:28 2022] POST /identity/v3/projects => generated 353 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:28.437808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba0b2-078a-456b-ad36-cefe936020bb tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.447624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c849043f-2cf9-4633-ba07-c18f3d2b879c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:28.448936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c849043f-2cf9-4633-ba07-c18f3d2b879c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:28.491359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:28.538998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1046/2087] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:28.546985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ba0b2-078a-456b-ad36-cefe936020bb tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.557243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849043f-2cf9-4633-ba07-c18f3d2b879c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.560009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8899bfa9265b4a12800dae08676cd121', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17eeda71a1b744c3a3a894ce7dccbc81', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.560650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.562098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.562493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.563361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:28.563749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.565590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.576425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849043f-2cf9-4633-ba07-c18f3d2b879c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.581147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1042/2088] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:39:28.589192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.590162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.592166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.593833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.595364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:28.596052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.599849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.632104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1047/2089] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:28.635267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.641260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.652016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43af18-d4f9-45af-bd79-62fb5db0601e tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.657138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fdb93-8b1d-4181-9c4d-ba9f9fc783f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.657758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fdb93-8b1d-4181-9c4d-ba9f9fc783f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.658106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fdb93-8b1d-4181-9c4d-ba9f9fc783f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.658368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fdb93-8b1d-4181-9c4d-ba9f9fc783f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.659008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fdb93-8b1d-4181-9c4d-ba9f9fc783f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.662080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52fdb93-8b1d-4181-9c4d-ba9f9fc783f0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.668625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b27321-45ee-4686-b72f-0a32a58b70d6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.707865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8899bfa9265b4a12800dae08676cd121', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17eeda71a1b744c3a3a894ce7dccbc81', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.708530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.708823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.709104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] PATH_INFO: `/v3/projects/75acf5524c3e4ad6a58bc66f808ce725` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.710381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Authorizing `identity:delete_project(project_id=75acf5524c3e4ad6a58bc66f808ce725)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.712487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.728503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1043/2090] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:28 2022] POST /identity/v3/projects => generated 385 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:28.733288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fdb93-8b1d-4181-9c4d-ba9f9fc783f0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.821349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75acf5524c3e4ad6a58bc66f808ce725', 'request_id': 'req-38de3293-70ed-4c86-bccc-013f1e110c8d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.833479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75acf5524c3e4ad6a58bc66f808ce725', 'request_id': 'req-38de3293-70ed-4c86-bccc-013f1e110c8d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.847681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75acf5524c3e4ad6a58bc66f808ce725', 'request_id': 'req-38de3293-70ed-4c86-bccc-013f1e110c8d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.869378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] The token cache is being invalidate because project 75acf5524c3e4ad6a58bc66f808ce725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:28.869949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.871092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:28.872922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1048/2091] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:28 2022] DELETE /identity/v3/projects/75acf5524c3e4ad6a58bc66f808ce725 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:28.881239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fdb93-8b1d-4181-9c4d-ba9f9fc783f0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:28.963818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28c47-7ba4-4ee8-bee7-7d2a2b808912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:28.964450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28c47-7ba4-4ee8-bee7-7d2a2b808912 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:28.964734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28c47-7ba4-4ee8-bee7-7d2a2b808912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:28.965011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa28c47-7ba4-4ee8-bee7-7d2a2b808912 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:28.965778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28c47-7ba4-4ee8-bee7-7d2a2b808912 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:28.967964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa28c47-7ba4-4ee8-bee7-7d2a2b808912 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:28.993737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1044/2092] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:28 2022] POST /identity/v3/users => generated 293 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:28.998013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:28.999839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:29.018894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de3293-70ed-4c86-bccc-013f1e110c8d tempest-VolumeQuotaClassesTest-407706285 tempest-VolumeQuotaClassesTest-407706285-project-admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.024621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508863b-2505-4c27-b427-9514418e06d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.025399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508863b-2505-4c27-b427-9514418e06d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.026451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508863b-2505-4c27-b427-9514418e06d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.026451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508863b-2505-4c27-b427-9514418e06d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.026792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508863b-2505-4c27-b427-9514418e06d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.028777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508863b-2505-4c27-b427-9514418e06d0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.041217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1049/2093] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:29.045941 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28c47-7ba4-4ee8-bee7-7d2a2b808912 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.061175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa28c47-7ba4-4ee8-bee7-7d2a2b808912 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.068154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41965171-4a2f-4324-ac88-bc9ca5fff62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.069358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965171-4a2f-4324-ac88-bc9ca5fff62c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.069648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965171-4a2f-4324-ac88-bc9ca5fff62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.069956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41965171-4a2f-4324-ac88-bc9ca5fff62c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.070626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41965171-4a2f-4324-ac88-bc9ca5fff62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.072424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41965171-4a2f-4324-ac88-bc9ca5fff62c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.089919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1045/2094] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:29.092766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508863b-2505-4c27-b427-9514418e06d0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.106798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508863b-2505-4c27-b427-9514418e06d0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.140472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.141208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.141501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.141787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] PATH_INFO: `/v3/projects/a0e0f94e60304e038e73a895e8bb7e8b/users/764c0aae89254253b39e275233c5bcf8/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.166272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0e0f94e60304e038e73a895e8bb7e8b, user_id=764c0aae89254253b39e275233c5bcf8, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.170382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.173991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.203848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1050/2095] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:29 2022] PUT /identity/v3/projects/a0e0f94e60304e038e73a895e8bb7e8b/users/764c0aae89254253b39e275233c5bcf8/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:29.215702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572f33-4556-4096-bb90-b523eb7d2394 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.216200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572f33-4556-4096-bb90-b523eb7d2394 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.216200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec572f33-4556-4096-bb90-b523eb7d2394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.236511 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.239028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:29.314683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ec572f33-4556-4096-bb90-b523eb7d2394 None None] MFA Rules not processed for user `764c0aae89254253b39e275233c5bcf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:29.316270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ec572f33-4556-4096-bb90-b523eb7d2394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:29.336087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8897f6bb-5585-4ef9-ae56-412c45c6ddc6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.341528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.342516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.342654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.342876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] PATH_INFO: `/v3/users/9c30bc30378a4818879e1ca0db4952ff` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.344047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c30bc30378a4818879e1ca0db4952ff)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.346896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.347402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.431214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c30bc30378a4818879e1ca0db4952ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:29.432705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c30bc30378a4818879e1ca0db4952ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:29.432827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1046/2096] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:29.438875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572f33-4556-4096-bb90-b523eb7d2394 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.445400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c30bc30378a4818879e1ca0db4952ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:29.455545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c30bc30378a4818879e1ca0db4952ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:29.458892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec572f33-4556-4096-bb90-b523eb7d2394 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.464411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.465222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.465605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.466067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.466777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.469197 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.473216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35e4fa24-525c-4550-89c0-15dcf530d3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c30bc30378a4818879e1ca0db4952ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:29.484586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1051/2097] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:29 2022] DELETE /identity/v3/users/9c30bc30378a4818879e1ca0db4952ff => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:29.486185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf698-6de0-4fdd-ac18-8625f4d16b96 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.486624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf698-6de0-4fdd-ac18-8625f4d16b96 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.487053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383cf698-6de0-4fdd-ac18-8625f4d16b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.508496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-383cf698-6de0-4fdd-ac18-8625f4d16b96 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:29.509634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-383cf698-6de0-4fdd-ac18-8625f4d16b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:29.522301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1047/2098] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:29 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:29.523405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.525361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:29.611386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1052/2099] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:29.617789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567fb1c-a616-40bd-88b4-ee963f4c704c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.627691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3b515-fdb6-4af6-b192-1ba6fa24f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.628594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b515-fdb6-4af6-b192-1ba6fa24f789 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.629038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b515-fdb6-4af6-b192-1ba6fa24f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.629585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3b515-fdb6-4af6-b192-1ba6fa24f789 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.630548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3b515-fdb6-4af6-b192-1ba6fa24f789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.632520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cf698-6de0-4fdd-ac18-8625f4d16b96 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.634140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-383cf698-6de0-4fdd-ac18-8625f4d16b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:29.635347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3b515-fdb6-4af6-b192-1ba6fa24f789 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.667351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:29.676854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1048/2100] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:29 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:29.687644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3b515-fdb6-4af6-b192-1ba6fa24f789 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.705481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3b515-fdb6-4af6-b192-1ba6fa24f789 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.721193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381576c-f632-4d95-a9ce-cdb7f2624e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.721950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381576c-f632-4d95-a9ce-cdb7f2624e01 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.722791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381576c-f632-4d95-a9ce-cdb7f2624e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.723406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381576c-f632-4d95-a9ce-cdb7f2624e01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.724385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381576c-f632-4d95-a9ce-cdb7f2624e01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.727082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381576c-f632-4d95-a9ce-cdb7f2624e01 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.746967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1049/2101] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:29.747231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383cf698-6de0-4fdd-ac18-8625f4d16b96 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.751045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381576c-f632-4d95-a9ce-cdb7f2624e01 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.764489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381576c-f632-4d95-a9ce-cdb7f2624e01 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.772434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154b041-4ccb-48bc-86f8-ac7c371c318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.773056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154b041-4ccb-48bc-86f8-ac7c371c318e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.773350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154b041-4ccb-48bc-86f8-ac7c371c318e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.773639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154b041-4ccb-48bc-86f8-ac7c371c318e admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.774483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154b041-4ccb-48bc-86f8-ac7c371c318e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.776544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d154b041-4ccb-48bc-86f8-ac7c371c318e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.805184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1050/2102] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:29.806761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154b041-4ccb-48bc-86f8-ac7c371c318e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:29.821204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154b041-4ccb-48bc-86f8-ac7c371c318e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:29.831477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6016a7-6514-439f-92f2-de1fdca87fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.833491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6016a7-6514-439f-92f2-de1fdca87fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.833785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6016a7-6514-439f-92f2-de1fdca87fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.834091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6016a7-6514-439f-92f2-de1fdca87fa4 admin admin] PATH_INFO: `/v3/projects/00361139819b446b862cfe48ff6a7ee8/users/1cc06d33ecd3400b88243876f92cb9c3/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.840041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dcdcfe-edef-4d10-b8f0-65a57fed39db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:29.841068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdcfe-edef-4d10-b8f0-65a57fed39db service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.841857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdcfe-edef-4d10-b8f0-65a57fed39db service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.842105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dcdcfe-edef-4d10-b8f0-65a57fed39db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.853693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6016a7-6514-439f-92f2-de1fdca87fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00361139819b446b862cfe48ff6a7ee8, user_id=1cc06d33ecd3400b88243876f92cb9c3, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.855856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcdcfe-edef-4d10-b8f0-65a57fed39db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:29.857570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dcdcfe-edef-4d10-b8f0-65a57fed39db service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.872880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6016a7-6514-439f-92f2-de1fdca87fa4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:29.882986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1053/2103] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:29.908154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1051/2104] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:29 2022] PUT /identity/v3/projects/00361139819b446b862cfe48ff6a7ee8/users/1cc06d33ecd3400b88243876f92cb9c3/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:29.919305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b711c-5092-43b8-b260-c762dd363d63 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:29.919629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b711c-5092-43b8-b260-c762dd363d63 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:29.919982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b711c-5092-43b8-b260-c762dd363d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:29.959790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5a9b711c-5092-43b8-b260-c762dd363d63 None None] MFA Rules not processed for user `1cc06d33ecd3400b88243876f92cb9c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:29.961240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5a9b711c-5092-43b8-b260-c762dd363d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:30.040125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1054/2105] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:30.045042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6016a7-6514-439f-92f2-de1fdca87fa4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.088747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.111996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6016a7-6514-439f-92f2-de1fdca87fa4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.117523 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.118240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.118601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.118951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.119670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.121590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.150071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1052/2106] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:30 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:30.154207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b711c-5092-43b8-b260-c762dd363d63 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.165676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b711c-5092-43b8-b260-c762dd363d63 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.216155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.218564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:30.240352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f04f3-833d-452b-9bea-d20b1688191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.241011 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f04f3-833d-452b-9bea-d20b1688191f admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.241299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f04f3-833d-452b-9bea-d20b1688191f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.241569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f04f3-833d-452b-9bea-d20b1688191f admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.242319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f04f3-833d-452b-9bea-d20b1688191f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.244295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f04f3-833d-452b-9bea-d20b1688191f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.254696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.272019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1055/2107] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:30 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:30.273139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f04f3-833d-452b-9bea-d20b1688191f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.284766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f04f3-833d-452b-9bea-d20b1688191f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.290630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58609d2f-b2db-4f75-8878-a4b9a70393e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.291377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58609d2f-b2db-4f75-8878-a4b9a70393e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.291736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58609d2f-b2db-4f75-8878-a4b9a70393e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.292081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58609d2f-b2db-4f75-8878-a4b9a70393e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.292748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58609d2f-b2db-4f75-8878-a4b9a70393e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.295050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58609d2f-b2db-4f75-8878-a4b9a70393e0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.296950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e7f05-2dac-4e89-b7e2-6861da6a948d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.303640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.304289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.304577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.304855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] PATH_INFO: `/v3/projects/a396390c57754b4f804369a25e42eb00` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.306019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a396390c57754b4f804369a25e42eb00)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.307013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1056/2108] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:30.308028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.310981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58609d2f-b2db-4f75-8878-a4b9a70393e0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.324260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58609d2f-b2db-4f75-8878-a4b9a70393e0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.340131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.340861 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.341359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.341488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] PATH_INFO: `/v3/projects/21bdd5bbffaa44088022a28e6abe4d2c/users/d0df04b5384c49e0bef8f1381386d9ef/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.367475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bdd5bbffaa44088022a28e6abe4d2c, user_id=d0df04b5384c49e0bef8f1381386d9ef, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.370317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a396390c57754b4f804369a25e42eb00', 'request_id': 'req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.371944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.379132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a396390c57754b4f804369a25e42eb00', 'request_id': 'req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.391065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a396390c57754b4f804369a25e42eb00', 'request_id': 'req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.395955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1057/2109] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:30 2022] PUT /identity/v3/projects/21bdd5bbffaa44088022a28e6abe4d2c/users/d0df04b5384c49e0bef8f1381386d9ef/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:30.395955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.397580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:30.406569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] The token cache is being invalidate because project a396390c57754b4f804369a25e42eb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:30.406888 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.407740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.409266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1053/2110] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:30 2022] DELETE /identity/v3/projects/a396390c57754b4f804369a25e42eb00 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:30.410734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.412109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:30.483020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.489519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314ebc9-2ef1-4fcb-81c0-8837b8e30a62 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.504513 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d7f30-dfc1-4b8e-9e5b-7e961acd65fb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.512185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.513453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.513842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.514342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] PATH_INFO: `/v3/users/534209fcaed54170af7c2e8e1f284987` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.515962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=534209fcaed54170af7c2e8e1f284987)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.518484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.572162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.574294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.574732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.575014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.575686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.579366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.592774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '534209fcaed54170af7c2e8e1f284987'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.593814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '534209fcaed54170af7c2e8e1f284987'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.597657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1054/2111] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:30.597657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.599873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:30.605102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '534209fcaed54170af7c2e8e1f284987'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.614299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '534209fcaed54170af7c2e8e1f284987'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.616778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84f7012-75db-4e4a-bcfc-fd34d395e495 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.622017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.622648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.622930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.623208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] PATH_INFO: `/v3/users/8899bfa9265b4a12800dae08676cd121` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.624384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8899bfa9265b4a12800dae08676cd121)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.626391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.636906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '534209fcaed54170af7c2e8e1f284987'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.653541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1058/2112] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:30 2022] DELETE /identity/v3/users/534209fcaed54170af7c2e8e1f284987 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:30.653541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.653541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:30.705386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8899bfa9265b4a12800dae08676cd121'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.731748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:30.766786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8899bfa9265b4a12800dae08676cd121'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.770162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8899bfa9265b4a12800dae08676cd121'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.785132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8899bfa9265b4a12800dae08676cd121'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.786260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfea53a0-971d-4179-a6ae-c63408680e26 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:30.791536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:30.792292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.792579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.792865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] PATH_INFO: `/v3/projects/21bdd5bbffaa44088022a28e6abe4d2c/users/d0df04b5384c49e0bef8f1381386d9ef/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.796325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21bdd5bbffaa44088022a28e6abe4d2c, user_id=d0df04b5384c49e0bef8f1381386d9ef, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:30.797508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5cce6249-4d4c-40da-abcf-7cec05bb01c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8899bfa9265b4a12800dae08676cd121'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:30.800656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:30.807450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1055/2113] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:30 2022] DELETE /identity/v3/users/8899bfa9265b4a12800dae08676cd121 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:30.810506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b85c-cfd5-4a7a-8c61-aaa79e73c348 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.810506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b85c-cfd5-4a7a-8c61-aaa79e73c348 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.810699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe85b85c-cfd5-4a7a-8c61-aaa79e73c348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:30.834710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-fe85b85c-cfd5-4a7a-8c61-aaa79e73c348 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:30.836792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fe85b85c-cfd5-4a7a-8c61-aaa79e73c348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:30.839837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1059/2114] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:30 2022] PUT /identity/v3/projects/21bdd5bbffaa44088022a28e6abe4d2c/users/d0df04b5384c49e0bef8f1381386d9ef/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:30.846934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:30.849491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:30.976339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1056/2115] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:30.979679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88629-fd72-4e80-9f99-9b65c0cd8bdd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:30.979815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88629-fd72-4e80-9f99-9b65c0cd8bdd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:30.981754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88629-fd72-4e80-9f99-9b65c0cd8bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.007875 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba5162-f44b-4946-9ad9-127a2994e9c9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.019463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.028956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.029277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.029562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.033056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.045474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.056871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c4c88629-fd72-4e80-9f99-9b65c0cd8bdd None None] MFA Rules not processed for user `d0df04b5384c49e0bef8f1381386d9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:31.059699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c4c88629-fd72-4e80-9f99-9b65c0cd8bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.136488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.138436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.154280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1060/2116] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:30 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:31.157721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1057/2117] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:30 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:31.158866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.160880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.193606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c88629-fd72-4e80-9f99-9b65c0cd8bdd None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.195872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c4c88629-fd72-4e80-9f99-9b65c0cd8bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.214419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c88629-fd72-4e80-9f99-9b65c0cd8bdd None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.219100 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff45ae4-1abe-443e-9106-83fc53793a57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.219822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45ae4-1abe-443e-9106-83fc53793a57 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.220218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45ae4-1abe-443e-9106-83fc53793a57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.221696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff45ae4-1abe-443e-9106-83fc53793a57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.225112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6ff45ae4-1abe-443e-9106-83fc53793a57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.241161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b04e482-6376-430f-b0e4-df82e277bb27 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.245402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.246438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.246832 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.247264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.260309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.262518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.280906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1061/2118] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:31.322694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45ae4-1abe-443e-9106-83fc53793a57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.325582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff45ae4-1abe-443e-9106-83fc53793a57 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.354053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1058/2119] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:31.468674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.470296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.513955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1381c-3f76-48d4-ab6f-afedf1d0a86f service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.533554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.535534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.539243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.539639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] PATH_INFO: `/v3/projects/17eeda71a1b744c3a3a894ce7dccbc81` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.542516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17eeda71a1b744c3a3a894ce7dccbc81)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.545308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.610401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:31.682436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17eeda71a1b744c3a3a894ce7dccbc81', 'request_id': 'req-ec6a9158-a75f-4bb4-8e23-688efc9263e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:31.690948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17eeda71a1b744c3a3a894ce7dccbc81', 'request_id': 'req-ec6a9158-a75f-4bb4-8e23-688efc9263e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:31.718571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17eeda71a1b744c3a3a894ce7dccbc81', 'request_id': 'req-ec6a9158-a75f-4bb4-8e23-688efc9263e0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:31.746736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] The token cache is being invalidate because project 17eeda71a1b744c3a3a894ce7dccbc81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:31.746736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:31.749980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:31.754202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1062/2120] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:31 2022] DELETE /identity/v3/projects/17eeda71a1b744c3a3a894ce7dccbc81 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:31.760350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964886-b688-4621-9039-6f2b46fa8a04 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.760719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964886-b688-4621-9039-6f2b46fa8a04 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.761400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24964886-b688-4621-9039-6f2b46fa8a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.780401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.782304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.809404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-24964886-b688-4621-9039-6f2b46fa8a04 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:31.813601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24964886-b688-4621-9039-6f2b46fa8a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.886312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a9158-a75f-4bb4-8e23-688efc9263e0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.907817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.910724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.913814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.914291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] PATH_INFO: `/v3/projects/5221ada8d9bb48f8914d88ef022a7da9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.915991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5221ada8d9bb48f8914d88ef022a7da9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.919799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:31.923692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1059/2121] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:31.925831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964886-b688-4621-9039-6f2b46fa8a04 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:31.928040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-24964886-b688-4621-9039-6f2b46fa8a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:31.943877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24964886-b688-4621-9039-6f2b46fa8a04 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:31.965274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:31.966151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:31.966732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:31.967161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] PATH_INFO: `/v3/users/ab683cbeb2504da5b5bc8a84c133ae80` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:31.968559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab683cbeb2504da5b5bc8a84c133ae80)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:31.971748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.017390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5221ada8d9bb48f8914d88ef022a7da9', 'request_id': 'req-c20400d3-3bb2-45fa-b957-8015660dcf30'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.021317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.025730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5221ada8d9bb48f8914d88ef022a7da9', 'request_id': 'req-c20400d3-3bb2-45fa-b957-8015660dcf30'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.034525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5221ada8d9bb48f8914d88ef022a7da9', 'request_id': 'req-c20400d3-3bb2-45fa-b957-8015660dcf30'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.041826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab683cbeb2504da5b5bc8a84c133ae80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.048288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] The token cache is being invalidate because project 5221ada8d9bb48f8914d88ef022a7da9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:32.048713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.049425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c20400d3-3bb2-45fa-b957-8015660dcf30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.055308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1063/2122] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:31 2022] DELETE /identity/v3/projects/5221ada8d9bb48f8914d88ef022a7da9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:32.055308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2703c-9f84-4e95-b79e-cd5935b0c02d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.055308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2703c-9f84-4e95-b79e-cd5935b0c02d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.055308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2703c-9f84-4e95-b79e-cd5935b0c02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.063867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab683cbeb2504da5b5bc8a84c133ae80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.064831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab683cbeb2504da5b5bc8a84c133ae80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.074677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab683cbeb2504da5b5bc8a84c133ae80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.076286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ede2703c-9f84-4e95-b79e-cd5935b0c02d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:32.077529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ede2703c-9f84-4e95-b79e-cd5935b0c02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:32.084159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-052ac651-e1b0-4fb1-b220-32c1dd02a247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab683cbeb2504da5b5bc8a84c133ae80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:32.091498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1060/2123] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:31 2022] DELETE /identity/v3/users/ab683cbeb2504da5b5bc8a84c133ae80 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:32.092873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef21cca-6707-4068-9821-e1cf3a1e7c06 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.093203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef21cca-6707-4068-9821-e1cf3a1e7c06 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.093480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef21cca-6707-4068-9821-e1cf3a1e7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.113675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9ef21cca-6707-4068-9821-e1cf3a1e7c06 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:32.114817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9ef21cca-6707-4068-9821-e1cf3a1e7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:32.120060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.157229 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1064/2124] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:32.159188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17aded-e805-4aac-9cd9-34653f408be1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.161385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17aded-e805-4aac-9cd9-34653f408be1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.161385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df17aded-e805-4aac-9cd9-34653f408be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.201316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1061/2125] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:32.202411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-df17aded-e805-4aac-9cd9-34653f408be1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:32.202753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef21cca-6707-4068-9821-e1cf3a1e7c06 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.203642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-df17aded-e805-4aac-9cd9-34653f408be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:32.215975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef21cca-6707-4068-9821-e1cf3a1e7c06 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.222143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.223801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.224352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.224782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.225778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:32.226406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.228889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.232771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1065/2126] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:32.236831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9bcc6-b905-4f86-819e-ab60b0072c1c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.237122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9bcc6-b905-4f86-819e-ab60b0072c1c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.237398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9bcc6-b905-4f86-819e-ab60b0072c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.261302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1062/2127] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:32.263091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.268847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:32.270638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-30e9bcc6-b905-4f86-819e-ab60b0072c1c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:32.271812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-30e9bcc6-b905-4f86-819e-ab60b0072c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:32.286049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1066/2128] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:32.287330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9bcc6-b905-4f86-819e-ab60b0072c1c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.304768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9bcc6-b905-4f86-819e-ab60b0072c1c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.307224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e15a-9fa4-4d80-8a2d-86d26ded061e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.307926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e15a-9fa4-4d80-8a2d-86d26ded061e admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.308298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e15a-9fa4-4d80-8a2d-86d26ded061e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.308649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a2e15a-9fa4-4d80-8a2d-86d26ded061e admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.309339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2e15a-9fa4-4d80-8a2d-86d26ded061e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.311345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a2e15a-9fa4-4d80-8a2d-86d26ded061e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.347738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1067/2129] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:32 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:32.349036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e15a-9fa4-4d80-8a2d-86d26ded061e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.363835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e80a719-4a8d-438e-bcdb-2cd5da580205 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.448339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280f56d-5f84-4ae9-8517-d08cc9c66ff2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.449038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f56d-5f84-4ae9-8517-d08cc9c66ff2 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.449375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f56d-5f84-4ae9-8517-d08cc9c66ff2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.449695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280f56d-5f84-4ae9-8517-d08cc9c66ff2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.455310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.504707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a2e15a-9fa4-4d80-8a2d-86d26ded061e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.535368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.536214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.536214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.536584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.537254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:32.537573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.541029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.558941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1068/2130] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:32.559972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.573368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24bafc-bd63-4edc-9645-8dd012b4567b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.584831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5bde-b006-43d7-97c7-f5a0273f3967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.585547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5bde-b006-43d7-97c7-f5a0273f3967 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.585968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5bde-b006-43d7-97c7-f5a0273f3967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.586351 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06f5bde-b006-43d7-97c7-f5a0273f3967 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.587091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f5bde-b006-43d7-97c7-f5a0273f3967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.589559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06f5bde-b006-43d7-97c7-f5a0273f3967 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.602542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280f56d-5f84-4ae9-8517-d08cc9c66ff2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.607199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280f56d-5f84-4ae9-8517-d08cc9c66ff2 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.623752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1069/2131] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:32 2022] POST /identity/v3/users => generated 287 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:32.625254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5bde-b006-43d7-97c7-f5a0273f3967 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.640023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1063/2132] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:32.640563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280f56d-5f84-4ae9-8517-d08cc9c66ff2 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.642348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06f5bde-b006-43d7-97c7-f5a0273f3967 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.650694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61a56-27bb-43e3-8438-420a6608f25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.652677 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61a56-27bb-43e3-8438-420a6608f25b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.653495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61a56-27bb-43e3-8438-420a6608f25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.654530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a61a56-27bb-43e3-8438-420a6608f25b admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.656578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61a56-27bb-43e3-8438-420a6608f25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.660533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a61a56-27bb-43e3-8438-420a6608f25b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.667830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280f56d-5f84-4ae9-8517-d08cc9c66ff2 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.683369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed279a-7570-427c-8635-517de1d0e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.684505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed279a-7570-427c-8635-517de1d0e967 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.684972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed279a-7570-427c-8635-517de1d0e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.685464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed279a-7570-427c-8635-517de1d0e967 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.686390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed279a-7570-427c-8635-517de1d0e967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.692217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed279a-7570-427c-8635-517de1d0e967 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.724462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1070/2133] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:32 2022] POST /identity/v3/projects => generated 397 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:32.724669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1064/2134] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:32.725738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61a56-27bb-43e3-8438-420a6608f25b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.725854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed279a-7570-427c-8635-517de1d0e967 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.748621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed279a-7570-427c-8635-517de1d0e967 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.856569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:32.866159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a61a56-27bb-43e3-8438-420a6608f25b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.874407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d638a9-0c90-41c4-970e-ed22cfd9c96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.875284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d638a9-0c90-41c4-970e-ed22cfd9c96c admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.875509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d638a9-0c90-41c4-970e-ed22cfd9c96c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.875894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d638a9-0c90-41c4-970e-ed22cfd9c96c admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.876641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d638a9-0c90-41c4-970e-ed22cfd9c96c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.879569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d638a9-0c90-41c4-970e-ed22cfd9c96c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.880514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b881f0-2ff9-4a3c-96ef-682122717f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.881141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b881f0-2ff9-4a3c-96ef-682122717f99 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.881431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b881f0-2ff9-4a3c-96ef-682122717f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.881796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b881f0-2ff9-4a3c-96ef-682122717f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.882451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b881f0-2ff9-4a3c-96ef-682122717f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.884166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b881f0-2ff9-4a3c-96ef-682122717f99 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.901688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1065/2135] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:32.905665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b881f0-2ff9-4a3c-96ef-682122717f99 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.920839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b881f0-2ff9-4a3c-96ef-682122717f99 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.934060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1071/2136] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:32 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:32.938215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d638a9-0c90-41c4-970e-ed22cfd9c96c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:32.939472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048b46d5-d5e2-44d1-bf31-68d93d9e3a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.940695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b46d5-d5e2-44d1-bf31-68d93d9e3a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.941855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b46d5-d5e2-44d1-bf31-68d93d9e3a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.942377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048b46d5-d5e2-44d1-bf31-68d93d9e3a2f admin admin] PATH_INFO: `/v3/projects/c8065d8b71884f349316422ec8a3d116/users/ef2588ba5cda41d6a5c06ebe9b888ee6/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.960134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d638a9-0c90-41c4-970e-ed22cfd9c96c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:32.972410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b46d5-d5e2-44d1-bf31-68d93d9e3a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8065d8b71884f349316422ec8a3d116, user_id=ef2588ba5cda41d6a5c06ebe9b888ee6, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.973349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad600314-51a7-4e50-a2fe-84cb32cfbb91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:32.974147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600314-51a7-4e50-a2fe-84cb32cfbb91 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:32.974553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600314-51a7-4e50-a2fe-84cb32cfbb91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:32.974834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad600314-51a7-4e50-a2fe-84cb32cfbb91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:32.975864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad600314-51a7-4e50-a2fe-84cb32cfbb91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:32.979298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad600314-51a7-4e50-a2fe-84cb32cfbb91 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:32.980208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048b46d5-d5e2-44d1-bf31-68d93d9e3a2f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.006662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1072/2137] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:33.010749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad600314-51a7-4e50-a2fe-84cb32cfbb91 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.019664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1066/2138] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:32 2022] PUT /identity/v3/projects/c8065d8b71884f349316422ec8a3d116/users/ef2588ba5cda41d6a5c06ebe9b888ee6/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:33.021999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0785fba-3519-4005-8684-106d3c0421d2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.022298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0785fba-3519-4005-8684-106d3c0421d2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.022587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0785fba-3519-4005-8684-106d3c0421d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.028831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad600314-51a7-4e50-a2fe-84cb32cfbb91 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.057965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c0785fba-3519-4005-8684-106d3c0421d2 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:33.059200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c0785fba-3519-4005-8684-106d3c0421d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:33.169214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.170308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.170596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.170873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.171536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.176281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.205691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1073/2139] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:33 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:33.205691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.208458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:33.236884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65b4f9-80d1-4ac7-a8a6-13669c08cf23 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.244347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.245566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.245694 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.246113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] PATH_INFO: `/v3/projects/b1c8cb6ee6054ae7aa3c8d583b556d01` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.248154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1067/2140] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:33.248679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c8cb6ee6054ae7aa3c8d583b556d01)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.248762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0785fba-3519-4005-8684-106d3c0421d2 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.250473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.255231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:33.264462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0785fba-3519-4005-8684-106d3c0421d2 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.270378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ed167-3c7d-484c-96bc-3fa6ee9179ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.271050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed167-3c7d-484c-96bc-3fa6ee9179ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.271585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed167-3c7d-484c-96bc-3fa6ee9179ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.272527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595ed167-3c7d-484c-96bc-3fa6ee9179ca admin admin] PATH_INFO: `/v3/projects/7fbcb44f1d2d438b8f46bc129c7f7192/users/6ce0d995a86a4869bc761457d3f668f1/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.301334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ed167-3c7d-484c-96bc-3fa6ee9179ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fbcb44f1d2d438b8f46bc129c7f7192, user_id=6ce0d995a86a4869bc761457d3f668f1, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.304421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595ed167-3c7d-484c-96bc-3fa6ee9179ca admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.324387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c8cb6ee6054ae7aa3c8d583b556d01', 'request_id': 'req-a80d8b0b-b670-4e57-8412-2a14613274ce'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.326545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1068/2141] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:33 2022] PUT /identity/v3/projects/7fbcb44f1d2d438b8f46bc129c7f7192/users/6ce0d995a86a4869bc761457d3f668f1/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:33.327444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ed167-3c7d-484c-96bc-3fa6ee9179ca admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.343553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c8cb6ee6054ae7aa3c8d583b556d01', 'request_id': 'req-a80d8b0b-b670-4e57-8412-2a14613274ce'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.353143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c8cb6ee6054ae7aa3c8d583b556d01', 'request_id': 'req-a80d8b0b-b670-4e57-8412-2a14613274ce'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.368330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] The token cache is being invalidate because project b1c8cb6ee6054ae7aa3c8d583b556d01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:33.368716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.369601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.375834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1074/2142] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:33 2022] DELETE /identity/v3/projects/b1c8cb6ee6054ae7aa3c8d583b556d01 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:33.375834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.375834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:33.404041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595ed167-3c7d-484c-96bc-3fa6ee9179ca admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.408244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1835c887-d904-4b7d-b969-884888a50df9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.408955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835c887-d904-4b7d-b969-884888a50df9 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.409281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835c887-d904-4b7d-b969-884888a50df9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.410714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1835c887-d904-4b7d-b969-884888a50df9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.412460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1835c887-d904-4b7d-b969-884888a50df9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:33.446723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d8b0b-b670-4e57-8412-2a14613274ce admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.452083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:33.490242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835c887-d904-4b7d-b969-884888a50df9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.491939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1835c887-d904-4b7d-b969-884888a50df9 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.504473 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1069/2143] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:33.506050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823511e-00f8-4f79-9cc6-21caf71f094f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.506280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823511e-00f8-4f79-9cc6-21caf71f094f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.506566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823511e-00f8-4f79-9cc6-21caf71f094f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.512494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.513639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.514074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.514450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.517152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:33.540807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c823511e-00f8-4f79-9cc6-21caf71f094f None None] MFA Rules not processed for user `6ce0d995a86a4869bc761457d3f668f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:33.542179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c823511e-00f8-4f79-9cc6-21caf71f094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:33.621085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.623054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.640080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1075/2144] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:33.641112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.642788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:33.653918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1070/2145] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:33.667835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823511e-00f8-4f79-9cc6-21caf71f094f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:33.669468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c823511e-00f8-4f79-9cc6-21caf71f094f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:33.675261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184f580-52de-4fdc-a04f-edce05151416 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.684651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.685628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.686126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.686753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] PATH_INFO: `/v3/users/30e88718914b4607b5df03090f2394c9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.688398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e88718914b4607b5df03090f2394c9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.693435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.693630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823511e-00f8-4f79-9cc6-21caf71f094f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:33.700012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e13d1-5d37-417f-be0c-f5f80b8cc437 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:33.700735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e13d1-5d37-417f-be0c-f5f80b8cc437 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:33.701056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e13d1-5d37-417f-be0c-f5f80b8cc437 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:33.701331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e13d1-5d37-417f-be0c-f5f80b8cc437 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:33.714992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e13d1-5d37-417f-be0c-f5f80b8cc437 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:33.716502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e13d1-5d37-417f-be0c-f5f80b8cc437 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:33.728672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1071/2146] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:33.817943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e88718914b4607b5df03090f2394c9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.818966 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e88718914b4607b5df03090f2394c9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.843945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e88718914b4607b5df03090f2394c9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.861037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e88718914b4607b5df03090f2394c9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.902294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e88718914b4607b5df03090f2394c9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:33.919960 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1076/2147] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:33 2022] DELETE /identity/v3/users/30e88718914b4607b5df03090f2394c9 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:34.700784 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e13d1-5d37-417f-be0c-f5f80b8cc437 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:34.709029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:34.712765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e13d1-5d37-417f-be0c-f5f80b8cc437 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:34.790354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb6bb1-c11b-4a3f-b988-55c04dcdc218 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:34.791468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6bb1-c11b-4a3f-b988-55c04dcdc218 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:34.792045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6bb1-c11b-4a3f-b988-55c04dcdc218 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:34.792555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb6bb1-c11b-4a3f-b988-55c04dcdc218 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:34.795063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-79bb6bb1-c11b-4a3f-b988-55c04dcdc218 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:34.799933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:34.801865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:34.905767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:34.969537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6bb1-c11b-4a3f-b988-55c04dcdc218 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:34.971381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bb6bb1-c11b-4a3f-b988-55c04dcdc218 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:34.982862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e059ed5-4e20-4cd3-acd5-c137dedf3b5b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:34.985462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1072/2148] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:34 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:34.999971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a766-eb3d-4f5c-bda2-3e2aede6573a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:34.999971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a766-eb3d-4f5c-bda2-3e2aede6573a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:34.999971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1a766-eb3d-4f5c-bda2-3e2aede6573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.001793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.003312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.004568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.005814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] PATH_INFO: `/v3/projects/ab949ac1d52a4e19b061fd4bc80b8735` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.009189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab949ac1d52a4e19b061fd4bc80b8735)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.016244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.069239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-44a1a766-eb3d-4f5c-bda2-3e2aede6573a None None] MFA Rules not processed for user `ef2588ba5cda41d6a5c06ebe9b888ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:35.070753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-44a1a766-eb3d-4f5c-bda2-3e2aede6573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:35.131461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab949ac1d52a4e19b061fd4bc80b8735', 'request_id': 'req-1f831ef1-febf-4f42-a19f-189c91e9706b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:35.151736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab949ac1d52a4e19b061fd4bc80b8735', 'request_id': 'req-1f831ef1-febf-4f42-a19f-189c91e9706b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:35.170141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab949ac1d52a4e19b061fd4bc80b8735', 'request_id': 'req-1f831ef1-febf-4f42-a19f-189c91e9706b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:35.195816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1073/2149] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:35.195816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1a766-eb3d-4f5c-bda2-3e2aede6573a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.195816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-44a1a766-eb3d-4f5c-bda2-3e2aede6573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:35.199469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] The token cache is being invalidate because project ab949ac1d52a4e19b061fd4bc80b8735 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:35.199785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:35.202657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f831ef1-febf-4f42-a19f-189c91e9706b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:35.203399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1a766-eb3d-4f5c-bda2-3e2aede6573a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.212261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1077/2150] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:34 2022] DELETE /identity/v3/projects/ab949ac1d52a4e19b061fd4bc80b8735 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:35.215096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992dbe-2c08-4add-b425-0e379d4f44dc None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.215390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992dbe-2c08-4add-b425-0e379d4f44dc None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.217356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9992dbe-2c08-4add-b425-0e379d4f44dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.246546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b9992dbe-2c08-4add-b425-0e379d4f44dc None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:35.247776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b9992dbe-2c08-4add-b425-0e379d4f44dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:35.266758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.306208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.308866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.309174 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.309459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.311554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.317865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.331158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1078/2151] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:35.341509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cd30-1b0a-4840-886a-a907b01374f1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.343683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cd30-1b0a-4840-886a-a907b01374f1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.344159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e85cd30-1b0a-4840-886a-a907b01374f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.376366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3e85cd30-1b0a-4840-886a-a907b01374f1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:35.377907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3e85cd30-1b0a-4840-886a-a907b01374f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:35.381724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1074/2152] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:35 2022] POST /identity/v3/projects => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:35.383519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.388147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:35.482217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1079/2153] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:35.486582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85cd30-1b0a-4840-886a-a907b01374f1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.491294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d7d1c-8856-4096-a4be-191e50715bf1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.499383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b9153-fc3b-4f34-a408-27f268412d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.499593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e85cd30-1b0a-4840-886a-a907b01374f1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.500412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b9153-fc3b-4f34-a408-27f268412d01 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.500958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b9153-fc3b-4f34-a408-27f268412d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.501386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6b9153-fc3b-4f34-a408-27f268412d01 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.502290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b9153-fc3b-4f34-a408-27f268412d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.504793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6b9153-fc3b-4f34-a408-27f268412d01 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.505525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.506322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.506880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.507225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.508013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:35.508385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.510756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.512679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:35.542919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1075/2154] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:35 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:35.547532 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1080/2155] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:35.548559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b9153-fc3b-4f34-a408-27f268412d01 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.552521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.574916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26633529-5bf4-4e69-8c28-f75e70a26d01 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.579453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6b9153-fc3b-4f34-a408-27f268412d01 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.584586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11deca-be42-47e8-9ad6-dd5fcbdfb5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.585314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11deca-be42-47e8-9ad6-dd5fcbdfb5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.585656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11deca-be42-47e8-9ad6-dd5fcbdfb5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.585869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11deca-be42-47e8-9ad6-dd5fcbdfb5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.586621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11deca-be42-47e8-9ad6-dd5fcbdfb5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.587543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ff606-f34e-463c-b7c4-0848c46e272d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.589033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11deca-be42-47e8-9ad6-dd5fcbdfb5d9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.591199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff606-f34e-463c-b7c4-0848c46e272d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.591726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff606-f34e-463c-b7c4-0848c46e272d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.592013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ff606-f34e-463c-b7c4-0848c46e272d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.592725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ff606-f34e-463c-b7c4-0848c46e272d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.594403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3ff606-f34e-463c-b7c4-0848c46e272d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.609037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1076/2156] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:35.624316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ff606-f34e-463c-b7c4-0848c46e272d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.647612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ff606-f34e-463c-b7c4-0848c46e272d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.661370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1081/2157] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:35 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:35.669116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2054242-40f9-42b0-bb46-214f19f144d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.669955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054242-40f9-42b0-bb46-214f19f144d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.670198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054242-40f9-42b0-bb46-214f19f144d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.670478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2054242-40f9-42b0-bb46-214f19f144d2 admin admin] PATH_INFO: `/v3/projects/bdfee5e453654a4d92db3d60e0e613cb/users/2db6daa8353741a89f575e8edee5abc6/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.674096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11deca-be42-47e8-9ad6-dd5fcbdfb5d9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.700643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2054242-40f9-42b0-bb46-214f19f144d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfee5e453654a4d92db3d60e0e613cb, user_id=2db6daa8353741a89f575e8edee5abc6, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.703804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2054242-40f9-42b0-bb46-214f19f144d2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.731208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1077/2158] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:35 2022] PUT /identity/v3/projects/bdfee5e453654a4d92db3d60e0e613cb/users/2db6daa8353741a89f575e8edee5abc6/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:35.736163 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2054242-40f9-42b0-bb46-214f19f144d2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.817107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11deca-be42-47e8-9ad6-dd5fcbdfb5d9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.849830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2054242-40f9-42b0-bb46-214f19f144d2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.855107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637fa1b-3b2c-4a13-8420-3ea617853207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.855839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637fa1b-3b2c-4a13-8420-3ea617853207 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.856198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637fa1b-3b2c-4a13-8420-3ea617853207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.856548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637fa1b-3b2c-4a13-8420-3ea617853207 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.857292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637fa1b-3b2c-4a13-8420-3ea617853207 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.859318 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637fa1b-3b2c-4a13-8420-3ea617853207 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.873568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1078/2159] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:35.877820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637fa1b-3b2c-4a13-8420-3ea617853207 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.893708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637fa1b-3b2c-4a13-8420-3ea617853207 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:35.902875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d868-407a-4081-8726-57d2f5ecf7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.903068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cec16c-8fb2-40d5-ae72-2d8e3cface06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:35.903551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d868-407a-4081-8726-57d2f5ecf7ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.903662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cec16c-8fb2-40d5-ae72-2d8e3cface06 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:35.903946 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cec16c-8fb2-40d5-ae72-2d8e3cface06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.904050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d868-407a-4081-8726-57d2f5ecf7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:35.904266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cec16c-8fb2-40d5-ae72-2d8e3cface06 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.904397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2d868-407a-4081-8726-57d2f5ecf7ff admin admin] PATH_INFO: `/v3/projects/bdfee5e453654a4d92db3d60e0e613cb/users/2db6daa8353741a89f575e8edee5abc6/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:35.905391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cec16c-8fb2-40d5-ae72-2d8e3cface06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.906770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2d868-407a-4081-8726-57d2f5ecf7ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdfee5e453654a4d92db3d60e0e613cb, user_id=2db6daa8353741a89f575e8edee5abc6, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:35.908263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cec16c-8fb2-40d5-ae72-2d8e3cface06 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.910018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2d868-407a-4081-8726-57d2f5ecf7ff admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:35.944104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1082/2160] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:35 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:35.947248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1079/2161] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:35 2022] PUT /identity/v3/projects/bdfee5e453654a4d92db3d60e0e613cb/users/2db6daa8353741a89f575e8edee5abc6/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:35.954660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cec16c-8fb2-40d5-ae72-2d8e3cface06 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:35.969404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cec16c-8fb2-40d5-ae72-2d8e3cface06 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.066801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a6f56-b043-481b-9d6d-274e2543f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.067880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a6f56-b043-481b-9d6d-274e2543f814 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.068345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a6f56-b043-481b-9d6d-274e2543f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.069167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a6f56-b043-481b-9d6d-274e2543f814 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.070135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a6f56-b043-481b-9d6d-274e2543f814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.071893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a6f56-b043-481b-9d6d-274e2543f814 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.097253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1083/2162] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:36.098680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d868-407a-4081-8726-57d2f5ecf7ff admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.116778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2d868-407a-4081-8726-57d2f5ecf7ff admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.120033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff61efa-5b4f-49d0-a0b5-7ffb35dca2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.120033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61efa-5b4f-49d0-a0b5-7ffb35dca2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.120033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61efa-5b4f-49d0-a0b5-7ffb35dca2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.120033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff61efa-5b4f-49d0-a0b5-7ffb35dca2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.120402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff61efa-5b4f-49d0-a0b5-7ffb35dca2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.122088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff61efa-5b4f-49d0-a0b5-7ffb35dca2c6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.123794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.141664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1080/2163] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:36.146367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a6f56-b043-481b-9d6d-274e2543f814 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.155193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:36.162295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a6f56-b043-481b-9d6d-274e2543f814 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.169050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28983ed-ad29-46d8-bc70-90b29193d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.169797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28983ed-ad29-46d8-bc70-90b29193d4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.170261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28983ed-ad29-46d8-bc70-90b29193d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.170553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28983ed-ad29-46d8-bc70-90b29193d4c2 admin admin] PATH_INFO: `/v3/projects/22d073ffa6664e7caac9e46c4db308e3/users/18fa22dc4bf24c61aa8ee3fe68d004ff/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.194510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28983ed-ad29-46d8-bc70-90b29193d4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d073ffa6664e7caac9e46c4db308e3, user_id=18fa22dc4bf24c61aa8ee3fe68d004ff, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.199158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28983ed-ad29-46d8-bc70-90b29193d4c2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.224834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1084/2164] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:36 2022] PUT /identity/v3/projects/22d073ffa6664e7caac9e46c4db308e3/users/18fa22dc4bf24c61aa8ee3fe68d004ff/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:36.239968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc056-0bdc-4f61-903f-1f75d5ff73fc None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.240369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc056-0bdc-4f61-903f-1f75d5ff73fc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.240740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441cc056-0bdc-4f61-903f-1f75d5ff73fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.284055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-441cc056-0bdc-4f61-903f-1f75d5ff73fc None None] MFA Rules not processed for user `18fa22dc4bf24c61aa8ee3fe68d004ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:36.285739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-441cc056-0bdc-4f61-903f-1f75d5ff73fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:36.428361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1081/2165] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:36.437158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28983ed-ad29-46d8-bc70-90b29193d4c2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.587051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28983ed-ad29-46d8-bc70-90b29193d4c2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.600615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1eda8-69d9-4771-84f0-ae77be1070c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.600615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1eda8-69d9-4771-84f0-ae77be1070c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.600615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1eda8-69d9-4771-84f0-ae77be1070c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.600615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1eda8-69d9-4771-84f0-ae77be1070c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.600983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1eda8-69d9-4771-84f0-ae77be1070c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.600983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d1eda8-69d9-4771-84f0-ae77be1070c9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.680702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1085/2166] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:36 2022] POST /identity/v3/projects => generated 371 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:36.680988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cc056-0bdc-4f61-903f-1f75d5ff73fc None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.709842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441cc056-0bdc-4f61-903f-1f75d5ff73fc None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.815888 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.816530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.816811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.817075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.818403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.822048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.863914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1082/2167] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:36 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:36.867235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1eda8-69d9-4771-84f0-ae77be1070c9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.876353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.878834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:36.886568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1eda8-69d9-4771-84f0-ae77be1070c9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.902720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafc22cb-5018-4774-8075-d491e6457296 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.907390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9d7d0-bf85-47f2-9254-cbc8ff39401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.908177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9d7d0-bf85-47f2-9254-cbc8ff39401e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.910545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9d7d0-bf85-47f2-9254-cbc8ff39401e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.913084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b9d7d0-bf85-47f2-9254-cbc8ff39401e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.914034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9d7d0-bf85-47f2-9254-cbc8ff39401e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.915639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.916463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.916947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.917367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] PATH_INFO: `/v3/users/71dc5db8bf4449b1901670581c996eef` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:36.919471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] RBAC: Authorizing `identity:delete_user(user_id=71dc5db8bf4449b1901670581c996eef)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:36.921732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.923119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b9d7d0-bf85-47f2-9254-cbc8ff39401e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:36.958717 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1086/2168] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:36.959589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9d7d0-bf85-47f2-9254-cbc8ff39401e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:36.974991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b9d7d0-bf85-47f2-9254-cbc8ff39401e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:36.981047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06df849-6f07-463f-adaf-160e522a5d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:36.981828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df849-6f07-463f-adaf-160e522a5d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:36.982510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df849-6f07-463f-adaf-160e522a5d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:36.982927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df849-6f07-463f-adaf-160e522a5d74 admin admin] PATH_INFO: `/v3/projects/32ee21e433814222be19f09d697c5cad/users/b012cc1a9f9643248e07089760901b82/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.025855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06df849-6f07-463f-adaf-160e522a5d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ee21e433814222be19f09d697c5cad, user_id=b012cc1a9f9643248e07089760901b82, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.036305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06df849-6f07-463f-adaf-160e522a5d74 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.051636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71dc5db8bf4449b1901670581c996eef'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:37.067300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1087/2169] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:36 2022] PUT /identity/v3/projects/32ee21e433814222be19f09d697c5cad/users/b012cc1a9f9643248e07089760901b82/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:37.069860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71dc5db8bf4449b1901670581c996eef'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:37.070849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71dc5db8bf4449b1901670581c996eef'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:37.072744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e8cb7-2e9c-4ce6-bb17-b7edb84aeab8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.074603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e8cb7-2e9c-4ce6-bb17-b7edb84aeab8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.075001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e8cb7-2e9c-4ce6-bb17-b7edb84aeab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.077613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.083868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71dc5db8bf4449b1901670581c996eef'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:37.097906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71dc5db8bf4449b1901670581c996eef'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:37.114857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1083/2170] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:36 2022] DELETE /identity/v3/users/71dc5db8bf4449b1901670581c996eef => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:37.144598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-155e8cb7-2e9c-4ce6-bb17-b7edb84aeab8 None None] MFA Rules not processed for user `2db6daa8353741a89f575e8edee5abc6`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:37.145651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-155e8cb7-2e9c-4ce6-bb17-b7edb84aeab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.146097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.148597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.270123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85082a3-646d-43ed-acc6-c2dfa68dd33e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.276163 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704712be-85fd-4d69-883f-333954b1dacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.277311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704712be-85fd-4d69-883f-333954b1dacd admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.277867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704712be-85fd-4d69-883f-333954b1dacd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.278243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704712be-85fd-4d69-883f-333954b1dacd admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.279535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704712be-85fd-4d69-883f-333954b1dacd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.281383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704712be-85fd-4d69-883f-333954b1dacd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.298773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1084/2171] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:37.298970 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1088/2172] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:37.299070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157bba2-4618-474e-b452-918eae4fa577 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.299070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157bba2-4618-474e-b452-918eae4fa577 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.299070 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157bba2-4618-474e-b452-918eae4fa577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.302344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e8cb7-2e9c-4ce6-bb17-b7edb84aeab8 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.322649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f157bba2-4618-474e-b452-918eae4fa577 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:37.323879 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f157bba2-4618-474e-b452-918eae4fa577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.327712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155e8cb7-2e9c-4ce6-bb17-b7edb84aeab8 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.333189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.333862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.334188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.334468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] PATH_INFO: `/v3/projects/32ee21e433814222be19f09d697c5cad/users/b012cc1a9f9643248e07089760901b82/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.335816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1085/2173] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:37.337510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6420b-90c5-406c-bf97-e29b589d9177 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.337919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6420b-90c5-406c-bf97-e29b589d9177 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.338297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6420b-90c5-406c-bf97-e29b589d9177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.345686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ee21e433814222be19f09d697c5cad, user_id=b012cc1a9f9643248e07089760901b82, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.349117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.362388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-77b6420b-90c5-406c-bf97-e29b589d9177 None None] MFA Rules not processed for user `ef2588ba5cda41d6a5c06ebe9b888ee6`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:37.363440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1089/2174] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:37 2022] PUT /identity/v3/projects/32ee21e433814222be19f09d697c5cad/users/b012cc1a9f9643248e07089760901b82/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:37.365164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.366605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-77b6420b-90c5-406c-bf97-e29b589d9177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.375241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.384454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.462558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1086/2175] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:37.463877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca49fe7-b757-4654-828b-8dc472edd415 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.464172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca49fe7-b757-4654-828b-8dc472edd415 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.464456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca49fe7-b757-4654-828b-8dc472edd415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.486352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c0921-e248-4f48-b1a0-20cda9152811 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.491821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.492638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.492929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.494012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.508218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bca49fe7-b757-4654-828b-8dc472edd415 None None] MFA Rules not processed for user `b012cc1a9f9643248e07089760901b82`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:37.510881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bca49fe7-b757-4654-828b-8dc472edd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.607517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.609545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.624538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1090/2176] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:37.625377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.626904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.632798 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1087/2177] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:37 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:37.641445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca49fe7-b757-4654-828b-8dc472edd415 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:37.642895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bca49fe7-b757-4654-828b-8dc472edd415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.655871 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:37.722580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca49fe7-b757-4654-828b-8dc472edd415 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.728944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f6cda-8a27-4162-b9c8-0fa24a91a9f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.729795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6cda-8a27-4162-b9c8-0fa24a91a9f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.730155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6cda-8a27-4162-b9c8-0fa24a91a9f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.730489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f6cda-8a27-4162-b9c8-0fa24a91a9f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.737381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e84930-123b-497f-af79-78da6c508a85 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:37.745452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f6cda-8a27-4162-b9c8-0fa24a91a9f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.746708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910147-661e-47b2-93f2-37f157f8ec27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:37.747209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57f6cda-8a27-4162-b9c8-0fa24a91a9f8 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.747396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910147-661e-47b2-93f2-37f157f8ec27 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.747774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910147-661e-47b2-93f2-37f157f8ec27 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.748058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910147-661e-47b2-93f2-37f157f8ec27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.750266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-55910147-661e-47b2-93f2-37f157f8ec27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:37.763168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910147-661e-47b2-93f2-37f157f8ec27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:37.765074 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1088/2178] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:37.765424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910147-661e-47b2-93f2-37f157f8ec27 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:37.776975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1091/2179] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:37.926881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014602-e3eb-4edc-ab7f-f699b08adec7 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.927414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014602-e3eb-4edc-ab7f-f699b08adec7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.927867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f014602-e3eb-4edc-ab7f-f699b08adec7 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:37.929423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1089/2180] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:39:37.950023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7aca-3aef-4dbe-84ae-209aa569700c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:37.950502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7aca-3aef-4dbe-84ae-209aa569700c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:37.950502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b7aca-3aef-4dbe-84ae-209aa569700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.014133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3a5b7aca-3aef-4dbe-84ae-209aa569700c None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:38.016093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3a5b7aca-3aef-4dbe-84ae-209aa569700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:38.040963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f014602-e3eb-4edc-ab7f-f699b08adec7 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.044689 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7f014602-e3eb-4edc-ab7f-f699b08adec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:38.085099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f014602-e3eb-4edc-ab7f-f699b08adec7 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.086555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.104613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.105281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.105580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.105843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] PATH_INFO: `/v3/users/36644d90057e4dd78064bd0a11627275` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.109666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36644d90057e4dd78064bd0a11627275)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.115963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.167071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1092/2181] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:39:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:38.168394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b7aca-3aef-4dbe-84ae-209aa569700c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.170385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3a5b7aca-3aef-4dbe-84ae-209aa569700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:38.193272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b7aca-3aef-4dbe-84ae-209aa569700c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.195528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36644d90057e4dd78064bd0a11627275'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.198385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.199042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.199329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.199767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] PATH_INFO: `/v3/projects/6181020786e54fec828a1e3d3b0b3d6e` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.200911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6181020786e54fec828a1e3d3b0b3d6e)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.202910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.230952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36644d90057e4dd78064bd0a11627275'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.231995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36644d90057e4dd78064bd0a11627275'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.249812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36644d90057e4dd78064bd0a11627275'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.265771 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36644d90057e4dd78064bd0a11627275'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.277046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1090/2182] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:38 2022] DELETE /identity/v3/users/36644d90057e4dd78064bd0a11627275 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:38.277383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6181020786e54fec828a1e3d3b0b3d6e', 'request_id': 'req-13142ce1-cc47-4110-8b37-199f33ae6545'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.286806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6181020786e54fec828a1e3d3b0b3d6e', 'request_id': 'req-13142ce1-cc47-4110-8b37-199f33ae6545'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.297137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6181020786e54fec828a1e3d3b0b3d6e', 'request_id': 'req-13142ce1-cc47-4110-8b37-199f33ae6545'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.318041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] The token cache is being invalidate because project 6181020786e54fec828a1e3d3b0b3d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:38.318588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.322968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.326175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1093/2183] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:38 2022] DELETE /identity/v3/projects/6181020786e54fec828a1e3d3b0b3d6e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:38.330237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.334311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:38.449522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.451099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:38.471446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296ed0a-b52b-46dd-8353-c685b761c3b0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.487027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.488461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.491266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.491822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] PATH_INFO: `/v3/users/c112c37db9b54c8b80e5f2f0f333430b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.495928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c112c37db9b54c8b80e5f2f0f333430b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.502836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.536560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.612182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c112c37db9b54c8b80e5f2f0f333430b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.621425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13142ce1-cc47-4110-8b37-199f33ae6545 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.656665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c112c37db9b54c8b80e5f2f0f333430b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.659702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c112c37db9b54c8b80e5f2f0f333430b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.687435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c112c37db9b54c8b80e5f2f0f333430b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.708487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c112c37db9b54c8b80e5f2f0f333430b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:38.730590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1091/2184] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:38 2022] DELETE /identity/v3/users/c112c37db9b54c8b80e5f2f0f333430b => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:38.732783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.734463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:38.770466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:38.796481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.797341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.797629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.797927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.812235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:38.827520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.829533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.845675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1094/2185] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:38.846619 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:38.849411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:38.869404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5c6f4-207a-49ae-83aa-2f6ec2e7b669 service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.903501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82382861-9fc6-418f-b27d-75217f4605e5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:38.911850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.912719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.913148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.913567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] PATH_INFO: `/v3/projects/7e749ca7c41548ffafe6adf83955a395` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.914948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e749ca7c41548ffafe6adf83955a395)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.918509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:38.966935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:38.967820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:38.968134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:38.968807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] PATH_INFO: `/v3/users/18fa22dc4bf24c61aa8ee3fe68d004ff` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:38.970353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18fa22dc4bf24c61aa8ee3fe68d004ff)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:38.974957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.011489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e749ca7c41548ffafe6adf83955a395', 'request_id': 'req-de3f3aa5-2718-4ba1-92b8-a4d37987e129'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.021279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e749ca7c41548ffafe6adf83955a395', 'request_id': 'req-de3f3aa5-2718-4ba1-92b8-a4d37987e129'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.033153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e749ca7c41548ffafe6adf83955a395', 'request_id': 'req-de3f3aa5-2718-4ba1-92b8-a4d37987e129'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.048095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] The token cache is being invalidate because project 7e749ca7c41548ffafe6adf83955a395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:39.048397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.049091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-de3f3aa5-2718-4ba1-92b8-a4d37987e129 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.052005 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1092/2186] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:38 2022] DELETE /identity/v3/projects/7e749ca7c41548ffafe6adf83955a395 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:39.052828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18fa22dc4bf24c61aa8ee3fe68d004ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.053610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18fa22dc4bf24c61aa8ee3fe68d004ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.057736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d01e-e59f-40b8-9965-5162c1d5a7ef None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.057736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d01e-e59f-40b8-9965-5162c1d5a7ef None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.058177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566d01e-e59f-40b8-9965-5162c1d5a7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.067629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18fa22dc4bf24c61aa8ee3fe68d004ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.078196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18fa22dc4bf24c61aa8ee3fe68d004ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.091201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e566d01e-e59f-40b8-9965-5162c1d5a7ef None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:39.093243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e566d01e-e59f-40b8-9965-5162c1d5a7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.095711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18fa22dc4bf24c61aa8ee3fe68d004ff'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.108039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1095/2187] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:38 2022] DELETE /identity/v3/users/18fa22dc4bf24c61aa8ee3fe68d004ff => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:39.109197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.111247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.126991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:39.180080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1093/2188] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:39.181574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5895-8e69-4b42-aeed-f96b9f873cdd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.181864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5895-8e69-4b42-aeed-f96b9f873cdd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.182173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf5895-8e69-4b42-aeed-f96b9f873cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.209404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6cbf5895-8e69-4b42-aeed-f96b9f873cdd None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:39.210677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6cbf5895-8e69-4b42-aeed-f96b9f873cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.219819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1094/2189] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:39.224725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c426a17-9528-438a-9fe5-c41b792afaeb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.225021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c426a17-9528-438a-9fe5-c41b792afaeb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.225301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c426a17-9528-438a-9fe5-c41b792afaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.232417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b748180-f96d-4bab-89b7-ae0335c79b4c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.242320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.242977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.243266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.243548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] PATH_INFO: `/v3/projects/e7fcf893a20f4a3e95d0e640c3cda95c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.244711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7fcf893a20f4a3e95d0e640c3cda95c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.246697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.248064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5c426a17-9528-438a-9fe5-c41b792afaeb None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:39.249480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5c426a17-9528-438a-9fe5-c41b792afaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.260141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1095/2190] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:39.261198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c426a17-9528-438a-9fe5-c41b792afaeb None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.263018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5c426a17-9528-438a-9fe5-c41b792afaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.265649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:39.310985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7fcf893a20f4a3e95d0e640c3cda95c', 'request_id': 'req-275eab24-552c-4cbe-ac32-689185b54f9a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.318205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7fcf893a20f4a3e95d0e640c3cda95c', 'request_id': 'req-275eab24-552c-4cbe-ac32-689185b54f9a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.326686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7fcf893a20f4a3e95d0e640c3cda95c', 'request_id': 'req-275eab24-552c-4cbe-ac32-689185b54f9a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.334208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c426a17-9528-438a-9fe5-c41b792afaeb None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.339615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] The token cache is being invalidate because project e7fcf893a20f4a3e95d0e640c3cda95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:39.340018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.340764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.342672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1096/2191] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:39 2022] DELETE /identity/v3/projects/e7fcf893a20f4a3e95d0e640c3cda95c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:39.351224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.355946 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.403066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.404123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.405304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.405750 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.410284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.469408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eab24-552c-4cbe-ac32-689185b54f9a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.476626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.477357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.477841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.478264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.479328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:39.479650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.481334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.499486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1097/2192] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:39.507153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.525002 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ade8b1-d9a4-49dd-b8ed-cda1a7c26e34 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.529196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.531798 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.544553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1096/2193] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:39.550678 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.551335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.556042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.556042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.556042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.556042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.599925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.608575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1098/2194] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:39 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:39.611474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.614752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d8787-0a7e-43b6-9fc7-dac860c0f1b3 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.616631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.655780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:39.711911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.712727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.713014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.713292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.713960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.715894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.716612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057bd990-40d0-4855-9f3b-88d861d5ba6a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.721993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.722845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.723138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.723418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] PATH_INFO: `/v3/users/764c0aae89254253b39e275233c5bcf8` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.724665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=764c0aae89254253b39e275233c5bcf8)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.727303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.745678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1097/2195] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:39 2022] POST /identity/v3/users => generated 288 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:39.746645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.748336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.763146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019512-0938-4369-b393-4fbc59ae426c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:39.763932 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:39.769507 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:39.770583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.770873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.771156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] PATH_INFO: `/v3/users/6ce0d995a86a4869bc761457d3f668f1` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.772423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ce0d995a86a4869bc761457d3f668f1)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:39.774415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:39.809317 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '764c0aae89254253b39e275233c5bcf8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.810287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '764c0aae89254253b39e275233c5bcf8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.834434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '764c0aae89254253b39e275233c5bcf8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.848582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '764c0aae89254253b39e275233c5bcf8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.860783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ce0d995a86a4869bc761457d3f668f1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.868635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '764c0aae89254253b39e275233c5bcf8'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.879212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1099/2196] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:39 2022] DELETE /identity/v3/users/764c0aae89254253b39e275233c5bcf8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:39.882537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:39.885123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.887908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ce0d995a86a4869bc761457d3f668f1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.888762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ce0d995a86a4869bc761457d3f668f1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.901757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ce0d995a86a4869bc761457d3f668f1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.910332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9f1d0497-6999-4d5e-a6e1-f8aca40a1f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ce0d995a86a4869bc761457d3f668f1'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:39.922328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1098/2197] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:39 2022] DELETE /identity/v3/users/6ce0d995a86a4869bc761457d3f668f1 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:39.928185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787ab8a-5f15-4ad2-81eb-444213c9689c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:39.928538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787ab8a-5f15-4ad2-81eb-444213c9689c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:39.928945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787ab8a-5f15-4ad2-81eb-444213c9689c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:39.952240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7787ab8a-5f15-4ad2-81eb-444213c9689c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:39.953477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7787ab8a-5f15-4ad2-81eb-444213c9689c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:39.971879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a598305-ca36-4903-816f-7c76483fc5a9 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.045311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1099/2198] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:40.046416 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e19fb3-f8e9-4ea5-adc6-8c6a53509e9a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.046708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e19fb3-f8e9-4ea5-adc6-8c6a53509e9a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.046989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e19fb3-f8e9-4ea5-adc6-8c6a53509e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.068129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.069135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.069440 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.069700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.070399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.071888 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e9e19fb3-f8e9-4ea5-adc6-8c6a53509e9a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:40.072018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.074085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e9e19fb3-f8e9-4ea5-adc6-8c6a53509e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.083336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1100/2199] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:40.083614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1100/2200] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:40.084522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e19fb3-f8e9-4ea5-adc6-8c6a53509e9a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.085167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.085835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e9e19fb3-f8e9-4ea5-adc6-8c6a53509e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.094890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.112038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a281fef-7e3b-48f1-b032-c1c1c8ec23d5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.114742 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:40.117786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.118467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.118750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.119022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] PATH_INFO: `/v3/projects/22d073ffa6664e7caac9e46c4db308e3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.120384 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d073ffa6664e7caac9e46c4db308e3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.122653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.158232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e19fb3-f8e9-4ea5-adc6-8c6a53509e9a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.159913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:40.163023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.163636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.163918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.164191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.174376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.177044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.180482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d073ffa6664e7caac9e46c4db308e3', 'request_id': 'req-f66e46fc-4d1a-47bc-ba47-9b134ebff141'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.186215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d073ffa6664e7caac9e46c4db308e3', 'request_id': 'req-f66e46fc-4d1a-47bc-ba47-9b134ebff141'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.187073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1101/2201] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:40.187866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.189246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.197561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d073ffa6664e7caac9e46c4db308e3', 'request_id': 'req-f66e46fc-4d1a-47bc-ba47-9b134ebff141'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.203476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b024a928-9c59-4bd6-af24-184ab3995eaa service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.223917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] The token cache is being invalidate because project 22d073ffa6664e7caac9e46c4db308e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:40.224265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.226330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.229162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1101/2202] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:40 2022] DELETE /identity/v3/projects/22d073ffa6664e7caac9e46c4db308e3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:40.232110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.232110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.303344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.304237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.305013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.305624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.306371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.308079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.323791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1102/2203] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:40.323791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.323791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.327299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e46fc-4d1a-47bc-ba47-9b134ebff141 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.333115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.333996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.334509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.335152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.337816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.341368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ae765-90ad-464d-80e3-606fa43f039e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.348374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.349027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.349315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.349600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] PATH_INFO: `/v3/users/b012cc1a9f9643248e07089760901b82` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.350816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b012cc1a9f9643248e07089760901b82)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.353089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.354905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.360196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.381724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1102/2204] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:40.382753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.384450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.399509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25271cc-6594-4bb2-8671-ddbabf3be219 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.406129 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19990880-50a2-41cd-903a-30bc3ad370d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.406807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19990880-50a2-41cd-903a-30bc3ad370d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.407144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19990880-50a2-41cd-903a-30bc3ad370d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.407434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19990880-50a2-41cd-903a-30bc3ad370d2 admin admin] PATH_INFO: `/v3/projects/4b514585751f4c1fac64196cdb1847e9/users/e1382292b43945b4871382306f36772a/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.422620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b012cc1a9f9643248e07089760901b82'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.428761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19990880-50a2-41cd-903a-30bc3ad370d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b514585751f4c1fac64196cdb1847e9, user_id=e1382292b43945b4871382306f36772a, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.431901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19990880-50a2-41cd-903a-30bc3ad370d2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.442950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b012cc1a9f9643248e07089760901b82'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.444189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b012cc1a9f9643248e07089760901b82'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.451742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1103/2205] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:40 2022] PUT /identity/v3/projects/4b514585751f4c1fac64196cdb1847e9/users/e1382292b43945b4871382306f36772a/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:40.456024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b012cc1a9f9643248e07089760901b82'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.458708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7559b-2a24-4590-916c-2167686295e2 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.458708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7559b-2a24-4590-916c-2167686295e2 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.459210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7559b-2a24-4590-916c-2167686295e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.470895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b012cc1a9f9643248e07089760901b82'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.481642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1103/2206] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:40 2022] DELETE /identity/v3/users/b012cc1a9f9643248e07089760901b82 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:40.482999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-25d7559b-2a24-4590-916c-2167686295e2 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:40.484303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-25d7559b-2a24-4590-916c-2167686295e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.552982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.554565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.570052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1104/2207] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:40.580081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7559b-2a24-4590-916c-2167686295e2 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.582216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-25d7559b-2a24-4590-916c-2167686295e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.626664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:40.649853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:40.686281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7559b-2a24-4590-916c-2167686295e2 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.699197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1571429-54c7-4929-909d-f1f3fb761f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.699982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571429-54c7-4929-909d-f1f3fb761f82 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.700287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571429-54c7-4929-909d-f1f3fb761f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.700555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1571429-54c7-4929-909d-f1f3fb761f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.705445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882e1ae-32f9-48fe-9509-5f7ba23e3c93 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.710858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.711629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.711987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.712320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] PATH_INFO: `/v3/projects/a0e0f94e60304e038e73a895e8bb7e8b` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.713575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1571429-54c7-4929-909d-f1f3fb761f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.714128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0e0f94e60304e038e73a895e8bb7e8b)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.715746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1571429-54c7-4929-909d-f1f3fb761f82 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.716173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.729404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1105/2208] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:40.788477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0e0f94e60304e038e73a895e8bb7e8b', 'request_id': 'req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.795513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0e0f94e60304e038e73a895e8bb7e8b', 'request_id': 'req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.806895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0e0f94e60304e038e73a895e8bb7e8b', 'request_id': 'req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.822781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] The token cache is being invalidate because project a0e0f94e60304e038e73a895e8bb7e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:40.823002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.823610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:40.825964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1104/2209] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:40 2022] DELETE /identity/v3/projects/a0e0f94e60304e038e73a895e8bb7e8b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:40.829991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1571429-54c7-4929-909d-f1f3fb761f82 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.841471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1571429-54c7-4929-909d-f1f3fb761f82 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:40.923652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:40.924310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:40.924657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:40.924971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] PATH_INFO: `/v3/users/1cc06d33ecd3400b88243876f92cb9c3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:40.926200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc06d33ecd3400b88243876f92cb9c3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:40.928147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:40.979451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:40.981783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:40.999829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8437f69a-7f2f-4485-b1ba-6d93a6fde1cf admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.002368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc06d33ecd3400b88243876f92cb9c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.003895 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc06d33ecd3400b88243876f92cb9c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.007352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.008658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.008956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.009564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] PATH_INFO: `/v3/projects/32ee21e433814222be19f09d697c5cad` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.011267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ee21e433814222be19f09d697c5cad)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.013664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.014815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc06d33ecd3400b88243876f92cb9c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.025967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc06d33ecd3400b88243876f92cb9c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.040663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc06d33ecd3400b88243876f92cb9c3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.049261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1106/2210] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:40 2022] DELETE /identity/v3/users/1cc06d33ecd3400b88243876f92cb9c3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:41.054269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.056100 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.119087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ee21e433814222be19f09d697c5cad', 'request_id': 'req-787dce03-88d4-4881-865a-65a25142c078'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.132904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ee21e433814222be19f09d697c5cad', 'request_id': 'req-787dce03-88d4-4881-865a-65a25142c078'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.152817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ee21e433814222be19f09d697c5cad', 'request_id': 'req-787dce03-88d4-4881-865a-65a25142c078'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.172917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] The token cache is being invalidate because project 32ee21e433814222be19f09d697c5cad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:41.173211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.174037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-787dce03-88d4-4881-865a-65a25142c078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.177428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1105/2211] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:40 2022] DELETE /identity/v3/projects/32ee21e433814222be19f09d697c5cad => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:41.182125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040868-7261-4002-b4d4-9a2bcfd38fff None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.182791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040868-7261-4002-b4d4-9a2bcfd38fff None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.183305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4040868-7261-4002-b4d4-9a2bcfd38fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.191664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:41.206036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699260-684c-4734-9f86-c3f3910cc7c2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.217451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f4040868-7261-4002-b4d4-9a2bcfd38fff None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:41.220095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f4040868-7261-4002-b4d4-9a2bcfd38fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.293987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:41.313392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.315604 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.315900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.316216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] PATH_INFO: `/v3/projects/7fbcb44f1d2d438b8f46bc129c7f7192` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.318378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fbcb44f1d2d438b8f46bc129c7f7192)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.320684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.330560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1106/2212] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:41.338670 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997d68-5bb0-41d9-8e09-f9fe1a35242d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.339114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997d68-5bb0-41d9-8e09-f9fe1a35242d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.339485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42997d68-5bb0-41d9-8e09-f9fe1a35242d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.369755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-42997d68-5bb0-41d9-8e09-f9fe1a35242d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:41.371835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-42997d68-5bb0-41d9-8e09-f9fe1a35242d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.390063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1107/2213] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:41.396304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42997d68-5bb0-41d9-8e09-f9fe1a35242d None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.399477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fbcb44f1d2d438b8f46bc129c7f7192', 'request_id': 'req-56572edd-8d4d-4152-a233-ec52fe4110f1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.411502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fbcb44f1d2d438b8f46bc129c7f7192', 'request_id': 'req-56572edd-8d4d-4152-a233-ec52fe4110f1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.412588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42997d68-5bb0-41d9-8e09-f9fe1a35242d None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.425558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fbcb44f1d2d438b8f46bc129c7f7192', 'request_id': 'req-56572edd-8d4d-4152-a233-ec52fe4110f1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.448266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] The token cache is being invalidate because project 7fbcb44f1d2d438b8f46bc129c7f7192 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:41.448852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.449663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-56572edd-8d4d-4152-a233-ec52fe4110f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.455222 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1107/2214] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:41 2022] DELETE /identity/v3/projects/7fbcb44f1d2d438b8f46bc129c7f7192 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:41.457516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a6a41-963f-4dd1-9ab9-76ea846adb84 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.458044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a6a41-963f-4dd1-9ab9-76ea846adb84 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.458499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a6a41-963f-4dd1-9ab9-76ea846adb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.486168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-651a6a41-963f-4dd1-9ab9-76ea846adb84 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:41.488293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-651a6a41-963f-4dd1-9ab9-76ea846adb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.565542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.566647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.567035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.567263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.568464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:41.568784 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.576219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.602439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1108/2215] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:41.603491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.607402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.629152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cb593-74fd-49c1-abe6-9d0ce86f7876 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.635957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.636982 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.637434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.637740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] PATH_INFO: `/v3/projects/00361139819b446b862cfe48ff6a7ee8` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.639193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00361139819b446b862cfe48ff6a7ee8)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.641321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.646038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1108/2216] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:41.652587 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a6a41-963f-4dd1-9ab9-76ea846adb84 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.655667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-651a6a41-963f-4dd1-9ab9-76ea846adb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.672706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a6a41-963f-4dd1-9ab9-76ea846adb84 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.682169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da39e07-e476-47f8-a430-3a9fedd3dd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.683225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39e07-e476-47f8-a430-3a9fedd3dd53 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.683526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39e07-e476-47f8-a430-3a9fedd3dd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.684281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da39e07-e476-47f8-a430-3a9fedd3dd53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.684731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da39e07-e476-47f8-a430-3a9fedd3dd53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.687357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da39e07-e476-47f8-a430-3a9fedd3dd53 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.715199 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00361139819b446b862cfe48ff6a7ee8', 'request_id': 'req-58b337fd-a223-4ebf-829b-c82ee597ef49'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.725229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00361139819b446b862cfe48ff6a7ee8', 'request_id': 'req-58b337fd-a223-4ebf-829b-c82ee597ef49'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.736306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1109/2217] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:41 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:41.738411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460e80-e846-4671-87ad-92eed8010dc0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.738811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460e80-e846-4671-87ad-92eed8010dc0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.739081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07460e80-e846-4671-87ad-92eed8010dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.739621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00361139819b446b862cfe48ff6a7ee8', 'request_id': 'req-58b337fd-a223-4ebf-829b-c82ee597ef49'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.754854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] The token cache is being invalidate because project 00361139819b446b862cfe48ff6a7ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:41.755400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.756824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.758699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1109/2218] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:41 2022] DELETE /identity/v3/projects/00361139819b446b862cfe48ff6a7ee8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:41.759835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.761780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.765387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-07460e80-e846-4671-87ad-92eed8010dc0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:41.767348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-07460e80-e846-4671-87ad-92eed8010dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.781297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:41.850327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:41.855687 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b337fd-a223-4ebf-829b-c82ee597ef49 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.861665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab67f4-6cb6-4b62-acfd-c84eacd9a3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.863418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab67f4-6cb6-4b62-acfd-c84eacd9a3f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.863847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab67f4-6cb6-4b62-acfd-c84eacd9a3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.864326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab67f4-6cb6-4b62-acfd-c84eacd9a3f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.865133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab67f4-6cb6-4b62-acfd-c84eacd9a3f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.868693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1110/2219] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:41.868855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab67f4-6cb6-4b62-acfd-c84eacd9a3f8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.868952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07460e80-e846-4671-87ad-92eed8010dc0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.870330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-07460e80-e846-4671-87ad-92eed8010dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:41.887025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07460e80-e846-4671-87ad-92eed8010dc0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.894411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.895364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.895654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.895936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] PATH_INFO: `/v3/users/d0df04b5384c49e0bef8f1381386d9ef` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.897563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0df04b5384c49e0bef8f1381386d9ef)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.900276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1110/2220] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:41 2022] POST /identity/v3/users => generated 296 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:41.900435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.900673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab67f4-6cb6-4b62-acfd-c84eacd9a3f8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.912123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab67f4-6cb6-4b62-acfd-c84eacd9a3f8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.917722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.918678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.919680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.919680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.920037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:41.920349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.921973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.938094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1111/2221] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:41.939769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:41.958125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5d6eb6-29b8-4224-9dfa-a0e67d241f38 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:41.967332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0df04b5384c49e0bef8f1381386d9ef'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.968103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0df04b5384c49e0bef8f1381386d9ef'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.969419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeaf71-7f86-4b50-b65c-d0b837dc53f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:41.970679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeaf71-7f86-4b50-b65c-d0b837dc53f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:41.971177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeaf71-7f86-4b50-b65c-d0b837dc53f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:41.972274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeaf71-7f86-4b50-b65c-d0b837dc53f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:41.973754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeaf71-7f86-4b50-b65c-d0b837dc53f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:41.975460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddeaf71-7f86-4b50-b65c-d0b837dc53f3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:41.986499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0df04b5384c49e0bef8f1381386d9ef'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.994706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1112/2222] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:41.996068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0df04b5384c49e0bef8f1381386d9ef'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:41.996181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeaf71-7f86-4b50-b65c-d0b837dc53f3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.011184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0df04b5384c49e0bef8f1381386d9ef'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:42.016723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeaf71-7f86-4b50-b65c-d0b837dc53f3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.020367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1111/2223] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:41 2022] DELETE /identity/v3/users/d0df04b5384c49e0bef8f1381386d9ef => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:42.021679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.024239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:42.026519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.027185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.027684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.027964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.028603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.030652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.082889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1113/2224] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:41 2022] POST /identity/v3/projects => generated 371 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:42.084739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.086722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:42.103342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654d46f-c23c-4fbd-a59e-9448e1c825c5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.153479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.207829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea4253-046b-4790-98e3-adfcca32bcfe admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.220524 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc6590-32fc-4d65-97db-c05f9989b6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.221173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6590-32fc-4d65-97db-c05f9989b6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.221441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6590-32fc-4d65-97db-c05f9989b6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.222644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc6590-32fc-4d65-97db-c05f9989b6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.222644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc6590-32fc-4d65-97db-c05f9989b6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.226645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc6590-32fc-4d65-97db-c05f9989b6c7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.231806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22460786-03fa-4767-88ad-71d632712dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.232431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460786-03fa-4767-88ad-71d632712dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.232717 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460786-03fa-4767-88ad-71d632712dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.233403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22460786-03fa-4767-88ad-71d632712dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.233693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22460786-03fa-4767-88ad-71d632712dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.238753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22460786-03fa-4767-88ad-71d632712dc5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.257601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1112/2225] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:42.260487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22460786-03fa-4767-88ad-71d632712dc5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.277837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1114/2226] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:42 2022] POST /identity/v3/users => generated 286 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:42.279141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc6590-32fc-4d65-97db-c05f9989b6c7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.290707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22460786-03fa-4767-88ad-71d632712dc5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.303153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc6590-32fc-4d65-97db-c05f9989b6c7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.305201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158b12e9-61c9-4525-9ef5-6fe66ebd4b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.305985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b12e9-61c9-4525-9ef5-6fe66ebd4b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.306381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b12e9-61c9-4525-9ef5-6fe66ebd4b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.307241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b12e9-61c9-4525-9ef5-6fe66ebd4b53 admin admin] PATH_INFO: `/v3/projects/9ec37801f8264a9f87b0e7ae0b78cf09/users/f5ab9b1bfc8b407088bb55d280434d0a/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.320720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f4cbd-7eda-4711-a4a6-6bba9e27db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.322192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f4cbd-7eda-4711-a4a6-6bba9e27db9b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.322969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f4cbd-7eda-4711-a4a6-6bba9e27db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.322969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f4cbd-7eda-4711-a4a6-6bba9e27db9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.323747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f4cbd-7eda-4711-a4a6-6bba9e27db9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.325839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f4cbd-7eda-4711-a4a6-6bba9e27db9b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.348642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b12e9-61c9-4525-9ef5-6fe66ebd4b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec37801f8264a9f87b0e7ae0b78cf09, user_id=f5ab9b1bfc8b407088bb55d280434d0a, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.357138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1115/2227] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:42.357768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158b12e9-61c9-4525-9ef5-6fe66ebd4b53 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.359967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f4cbd-7eda-4711-a4a6-6bba9e27db9b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.375147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f4cbd-7eda-4711-a4a6-6bba9e27db9b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.388019 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1113/2228] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:42 2022] PUT /identity/v3/projects/9ec37801f8264a9f87b0e7ae0b78cf09/users/f5ab9b1bfc8b407088bb55d280434d0a/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:42.391374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78878-b210-4478-9ae1-51d796b78e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.392192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78878-b210-4478-9ae1-51d796b78e2b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.392733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78878-b210-4478-9ae1-51d796b78e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.393217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d78878-b210-4478-9ae1-51d796b78e2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.394735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d78878-b210-4478-9ae1-51d796b78e2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.396588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d78878-b210-4478-9ae1-51d796b78e2b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.399893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd17cb-055f-4d78-b0c6-b30a4c375809 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.400443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd17cb-055f-4d78-b0c6-b30a4c375809 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.400941 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd17cb-055f-4d78-b0c6-b30a4c375809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.433063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1116/2229] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:42.437651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78878-b210-4478-9ae1-51d796b78e2b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.459873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-44bd17cb-055f-4d78-b0c6-b30a4c375809 None None] MFA Rules not processed for user `f5ab9b1bfc8b407088bb55d280434d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:42.460535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-44bd17cb-055f-4d78-b0c6-b30a4c375809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:42.471196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d78878-b210-4478-9ae1-51d796b78e2b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.589979 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1114/2230] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:42 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:42.591292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd17cb-055f-4d78-b0c6-b30a4c375809 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.596188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-44bd17cb-055f-4d78-b0c6-b30a4c375809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:42.608840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6710-7a69-4632-a30e-1e89585ec39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.609946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6710-7a69-4632-a30e-1e89585ec39b admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.610409 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6710-7a69-4632-a30e-1e89585ec39b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.610859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5a6710-7a69-4632-a30e-1e89585ec39b admin admin] PATH_INFO: `/v3/projects/b821353c40f7461885a9c0cdd7b2705d/users/af6775ff7d674767af4e7d19290cd684/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.640779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.646082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6710-7a69-4632-a30e-1e89585ec39b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b821353c40f7461885a9c0cdd7b2705d, user_id=af6775ff7d674767af4e7d19290cd684, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.650685 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5a6710-7a69-4632-a30e-1e89585ec39b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.674539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1117/2231] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:42 2022] PUT /identity/v3/projects/b821353c40f7461885a9c0cdd7b2705d/users/af6775ff7d674767af4e7d19290cd684/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:42.676608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6710-7a69-4632-a30e-1e89585ec39b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.703520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd17cb-055f-4d78-b0c6-b30a4c375809 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.765154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5a6710-7a69-4632-a30e-1e89585ec39b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.772328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd77a13-4f5d-4538-bfa2-8bfcef67f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.773765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77a13-4f5d-4538-bfa2-8bfcef67f125 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.774667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77a13-4f5d-4538-bfa2-8bfcef67f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.775118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd77a13-4f5d-4538-bfa2-8bfcef67f125 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.776513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd77a13-4f5d-4538-bfa2-8bfcef67f125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.778946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd77a13-4f5d-4538-bfa2-8bfcef67f125 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.780517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:42.807836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.808576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.809540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.809827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] PATH_INFO: `/v3/projects/21bdd5bbffaa44088022a28e6abe4d2c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.811314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21bdd5bbffaa44088022a28e6abe4d2c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:42.813797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:42.827052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1118/2232] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:42 2022] POST /identity/v3/projects => generated 391 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:42.831929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b9fc-a82c-47e2-a148-617e3f5c127e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.832230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b9fc-a82c-47e2-a148-617e3f5c127e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.832512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00b9fc-a82c-47e2-a148-617e3f5c127e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.865472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ca00b9fc-a82c-47e2-a148-617e3f5c127e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:42.867041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ca00b9fc-a82c-47e2-a148-617e3f5c127e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:42.895485 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21bdd5bbffaa44088022a28e6abe4d2c', 'request_id': 'req-2e013251-3167-4ac4-8219-331c96e7ba69'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:42.907089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21bdd5bbffaa44088022a28e6abe4d2c', 'request_id': 'req-2e013251-3167-4ac4-8219-331c96e7ba69'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:42.927026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21bdd5bbffaa44088022a28e6abe4d2c', 'request_id': 'req-2e013251-3167-4ac4-8219-331c96e7ba69'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:42.948924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] The token cache is being invalidate because project 21bdd5bbffaa44088022a28e6abe4d2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:42.949350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:42.950186 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:42.953558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1115/2233] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:42 2022] DELETE /identity/v3/projects/21bdd5bbffaa44088022a28e6abe4d2c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:42.954462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:42.959435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:42.979546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1119/2234] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:42.979779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2fc75-d85e-454f-bfbc-e6dbe8d06004 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.979985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2fc75-d85e-454f-bfbc-e6dbe8d06004 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.980176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2fc75-d85e-454f-bfbc-e6dbe8d06004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.989537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e013251-3167-4ac4-8219-331c96e7ba69 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:42.996046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebc449-5f72-4fa7-915f-5e79a0e9e3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:42.997601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc449-5f72-4fa7-915f-5e79a0e9e3ef admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:42.997907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc449-5f72-4fa7-915f-5e79a0e9e3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:42.998366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebc449-5f72-4fa7-915f-5e79a0e9e3ef admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:42.999244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebc449-5f72-4fa7-915f-5e79a0e9e3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.004108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebc449-5f72-4fa7-915f-5e79a0e9e3ef admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.014082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0cf2fc75-d85e-454f-bfbc-e6dbe8d06004 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:43.019327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0cf2fc75-d85e-454f-bfbc-e6dbe8d06004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:43.030363 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1120/2235] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:43.031544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2fc75-d85e-454f-bfbc-e6dbe8d06004 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.039042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0cf2fc75-d85e-454f-bfbc-e6dbe8d06004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:43.052079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1116/2236] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:42 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:43.052079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930ed6-5560-4b38-83a8-4148eb14731e None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.052079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930ed6-5560-4b38-83a8-4148eb14731e None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.052079 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76930ed6-5560-4b38-83a8-4148eb14731e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.077451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-76930ed6-5560-4b38-83a8-4148eb14731e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:43.078882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-76930ed6-5560-4b38-83a8-4148eb14731e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:43.091409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1117/2237] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:43.095936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76930ed6-5560-4b38-83a8-4148eb14731e None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.122520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76930ed6-5560-4b38-83a8-4148eb14731e None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.132984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3ea53-a9b7-445f-b03f-e02f10a8bf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.135638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3ea53-a9b7-445f-b03f-e02f10a8bf04 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.136148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3ea53-a9b7-445f-b03f-e02f10a8bf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.136556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3ea53-a9b7-445f-b03f-e02f10a8bf04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.137403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3ea53-a9b7-445f-b03f-e02f10a8bf04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.141583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3ea53-a9b7-445f-b03f-e02f10a8bf04 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.156096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1118/2238] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:43.157036 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3ea53-a9b7-445f-b03f-e02f10a8bf04 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.165474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2fc75-d85e-454f-bfbc-e6dbe8d06004 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.169815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e295c8-e619-426e-8acd-c1946d8963d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.170586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e295c8-e619-426e-8acd-c1946d8963d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.170971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e295c8-e619-426e-8acd-c1946d8963d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.171394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e295c8-e619-426e-8acd-c1946d8963d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.172690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3ea53-a9b7-445f-b03f-e02f10a8bf04 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.183283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.184033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.184342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e295c8-e619-426e-8acd-c1946d8963d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.184439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.185296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.186495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e295c8-e619-426e-8acd-c1946d8963d6 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.186617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:43.186900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.189664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.203459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1121/2239] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:43.212210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1119/2240] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:43.215737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e295c8-e619-426e-8acd-c1946d8963d6 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.221301 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.236983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e295c8-e619-426e-8acd-c1946d8963d6 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.252097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119c4c5-31cb-405c-bd98-64a501e24a7e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.255071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7c5b-4d7a-44da-93ef-3ac66c1ecc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.255973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7c5b-4d7a-44da-93ef-3ac66c1ecc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.256797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7c5b-4d7a-44da-93ef-3ac66c1ecc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.257795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4518787-d027-4eac-9efd-489d0293e48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.258020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ed7c5b-4d7a-44da-93ef-3ac66c1ecc8f admin admin] PATH_INFO: `/v3/projects/93adc9bb079c493eb70484c871f628d4/users/b71053f8e96b412fa771927d7b275537/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.258585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518787-d027-4eac-9efd-489d0293e48b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.259020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518787-d027-4eac-9efd-489d0293e48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.259297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4518787-d027-4eac-9efd-489d0293e48b admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.259930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4518787-d027-4eac-9efd-489d0293e48b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.262624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4518787-d027-4eac-9efd-489d0293e48b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.276704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.295830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed7c5b-4d7a-44da-93ef-3ac66c1ecc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=93adc9bb079c493eb70484c871f628d4, user_id=b71053f8e96b412fa771927d7b275537, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.298684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ed7c5b-4d7a-44da-93ef-3ac66c1ecc8f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.318430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1122/2241] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:43 2022] PUT /identity/v3/projects/93adc9bb079c493eb70484c871f628d4/users/b71053f8e96b412fa771927d7b275537/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:43.323061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7c5b-4d7a-44da-93ef-3ac66c1ecc8f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.354436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1120/2242] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:43 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:43.358029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4518787-d027-4eac-9efd-489d0293e48b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.433107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ed7c5b-4d7a-44da-93ef-3ac66c1ecc8f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.507162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4518787-d027-4eac-9efd-489d0293e48b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.514712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ea4cf-5c41-446e-89f9-437d34d4ee99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.515829 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea4cf-5c41-446e-89f9-437d34d4ee99 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.516165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea4cf-5c41-446e-89f9-437d34d4ee99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.516780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ea4cf-5c41-446e-89f9-437d34d4ee99 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.517575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ea4cf-5c41-446e-89f9-437d34d4ee99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.521309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ea4cf-5c41-446e-89f9-437d34d4ee99 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.531786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1116f-1c8f-4be0-9c5d-e9ad897883de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.533701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1116f-1c8f-4be0-9c5d-e9ad897883de admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.533814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.534775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1116f-1c8f-4be0-9c5d-e9ad897883de admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.535298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e1116f-1c8f-4be0-9c5d-e9ad897883de admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.536210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1116f-1c8f-4be0-9c5d-e9ad897883de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.538009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e1116f-1c8f-4be0-9c5d-e9ad897883de admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.555041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1123/2243] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:43.555236 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1121/2244] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:43 2022] POST /identity/v3/users => generated 288 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:39:43.562148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1116f-1c8f-4be0-9c5d-e9ad897883de admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.563210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ea4cf-5c41-446e-89f9-437d34d4ee99 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.569867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e1116f-1c8f-4be0-9c5d-e9ad897883de admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.580818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3a021-4823-4c87-a19b-7be127146cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.582724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3a021-4823-4c87-a19b-7be127146cee admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.582866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ea4cf-5c41-446e-89f9-437d34d4ee99 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.583036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3a021-4823-4c87-a19b-7be127146cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.583566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3a021-4823-4c87-a19b-7be127146cee admin admin] PATH_INFO: `/v3/projects/93adc9bb079c493eb70484c871f628d4/users/b71053f8e96b412fa771927d7b275537/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.585805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3a021-4823-4c87-a19b-7be127146cee admin admin] RBAC: Authorizing `identity:create_grant(project_id=93adc9bb079c493eb70484c871f628d4, user_id=b71053f8e96b412fa771927d7b275537, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.587764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c09b11-6944-4c08-8236-6154181e742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.588527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09b11-6944-4c08-8236-6154181e742a admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.588805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3a021-4823-4c87-a19b-7be127146cee admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.588912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09b11-6944-4c08-8236-6154181e742a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.589085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c09b11-6944-4c08-8236-6154181e742a admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.590060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c09b11-6944-4c08-8236-6154181e742a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.591680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c09b11-6944-4c08-8236-6154181e742a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.607645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1122/2245] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:43.614024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1124/2246] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:43 2022] PUT /identity/v3/projects/93adc9bb079c493eb70484c871f628d4/users/b71053f8e96b412fa771927d7b275537/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:43.614221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c09b11-6944-4c08-8236-6154181e742a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.623855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f9828-f439-47f8-ac09-8b855e100324 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.624212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f9828-f439-47f8-ac09-8b855e100324 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.624744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f9828-f439-47f8-ac09-8b855e100324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.629375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c09b11-6944-4c08-8236-6154181e742a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.661155 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b35f9828-f439-47f8-ac09-8b855e100324 None None] MFA Rules not processed for user `b71053f8e96b412fa771927d7b275537`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:43.662795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b35f9828-f439-47f8-ac09-8b855e100324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:43.728245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8606b-b463-4bc9-9ffd-3889011687fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.730063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8606b-b463-4bc9-9ffd-3889011687fb admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.730629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8606b-b463-4bc9-9ffd-3889011687fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.731135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb8606b-b463-4bc9-9ffd-3889011687fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.732866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8606b-b463-4bc9-9ffd-3889011687fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.735491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb8606b-b463-4bc9-9ffd-3889011687fb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.749565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1125/2247] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:43.752865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1123/2248] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:43.756175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8606b-b463-4bc9-9ffd-3889011687fb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.762736 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f9828-f439-47f8-ac09-8b855e100324 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.764343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b35f9828-f439-47f8-ac09-8b855e100324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:43.773389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:43.810512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb8606b-b463-4bc9-9ffd-3889011687fb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.837564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.839088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.839945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.841194 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] PATH_INFO: `/v3/projects/1c43f06120314e99a313f6ed1b6f5682/users/dde0d8991b144052bb522a4c89a2bce0/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.856811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f9828-f439-47f8-ac09-8b855e100324 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:43.867329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526210b-2668-4730-8193-fda116be2c8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:43.868017 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526210b-2668-4730-8193-fda116be2c8e service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.868441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526210b-2668-4730-8193-fda116be2c8e service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.868549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526210b-2668-4730-8193-fda116be2c8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.880634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526210b-2668-4730-8193-fda116be2c8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.882475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526210b-2668-4730-8193-fda116be2c8e service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.891439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c43f06120314e99a313f6ed1b6f5682, user_id=dde0d8991b144052bb522a4c89a2bce0, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:43.897749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1126/2249] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:43.898439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:43.920482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1124/2250] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:43 2022] PUT /identity/v3/projects/1c43f06120314e99a313f6ed1b6f5682/users/dde0d8991b144052bb522a4c89a2bce0/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:43.931787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f59de6-045f-4649-a461-7c08276a1a90 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:43.932359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f59de6-045f-4649-a461-7c08276a1a90 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:43.932917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f59de6-045f-4649-a461-7c08276a1a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:43.986917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:43.989906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:44.009832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-40f59de6-045f-4649-a461-7c08276a1a90 None None] MFA Rules not processed for user `dde0d8991b144052bb522a4c89a2bce0`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:44.012464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-40f59de6-045f-4649-a461-7c08276a1a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:44.076890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4a9ae-bf5d-409a-951c-e66aeb29fa4d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.085732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.087207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.087648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.088470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.093395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:44.124062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1127/2251] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:44.143046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f59de6-045f-4649-a461-7c08276a1a90 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:44.155547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f59de6-045f-4649-a461-7c08276a1a90 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:44.167709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e44af-a17e-484c-8b9a-e55e0aebf048 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:44.168602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e44af-a17e-484c-8b9a-e55e0aebf048 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:44.168883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e44af-a17e-484c-8b9a-e55e0aebf048 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:44.169172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e44af-a17e-484c-8b9a-e55e0aebf048 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:44.194644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e44af-a17e-484c-8b9a-e55e0aebf048 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.197840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4e44af-a17e-484c-8b9a-e55e0aebf048 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.222420 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:44.224073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:44.228330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1128/2252] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:44.254344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1125/2253] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:49.655048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f4dd-ba6e-44a0-a8ce-f20cd4d81c4e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:49.655618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f4dd-ba6e-44a0-a8ce-f20cd4d81c4e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:49.656007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671f4dd-ba6e-44a0-a8ce-f20cd4d81c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:49.736454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2671f4dd-ba6e-44a0-a8ce-f20cd4d81c4e None None] MFA Rules not processed for user `af6775ff7d674767af4e7d19290cd684`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:49.739012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2671f4dd-ba6e-44a0-a8ce-f20cd4d81c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:49.895770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1129/2254] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:49.897051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:49.899498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:49.944245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:50.072637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c483195-28f7-4080-b00f-73c52bb3cbc7 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.084512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731201bf-9f19-4189-80cb-a4decac76ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.085345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731201bf-9f19-4189-80cb-a4decac76ebb admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.085822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731201bf-9f19-4189-80cb-a4decac76ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.086093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731201bf-9f19-4189-80cb-a4decac76ebb admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.087614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731201bf-9f19-4189-80cb-a4decac76ebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.093125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731201bf-9f19-4189-80cb-a4decac76ebb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.161161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1126/2255] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:49 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:50.165333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f4dd-ba6e-44a0-a8ce-f20cd4d81c4e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.188817 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671f4dd-ba6e-44a0-a8ce-f20cd4d81c4e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.202306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:50.267561 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731201bf-9f19-4189-80cb-a4decac76ebb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.363156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e38f-9d9a-48e3-a838-14251819ff06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.363989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e38f-9d9a-48e3-a838-14251819ff06 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.364269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e38f-9d9a-48e3-a838-14251819ff06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.364543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e67e38f-9d9a-48e3-a838-14251819ff06 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.372226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e38f-9d9a-48e3-a838-14251819ff06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.374312 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e67e38f-9d9a-48e3-a838-14251819ff06 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.409269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1130/2256] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:50 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:50.412984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e38f-9d9a-48e3-a838-14251819ff06 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.444533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e67e38f-9d9a-48e3-a838-14251819ff06 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.478935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeaaf0-9f3b-4932-b358-48966c2da7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.482506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeaaf0-9f3b-4932-b358-48966c2da7ef admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.486551 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeaaf0-9f3b-4932-b358-48966c2da7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.493149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeaaf0-9f3b-4932-b358-48966c2da7ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.494108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeaaf0-9f3b-4932-b358-48966c2da7ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.502393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeaaf0-9f3b-4932-b358-48966c2da7ef admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.508391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731201bf-9f19-4189-80cb-a4decac76ebb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.532265 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.532925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.533210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.533488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] PATH_INFO: `/v3/users/f5ab9b1bfc8b407088bb55d280434d0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.535300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5ab9b1bfc8b407088bb55d280434d0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.537273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.538086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1131/2257] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:39:50.542012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeaaf0-9f3b-4932-b358-48966c2da7ef admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.563224 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeaaf0-9f3b-4932-b358-48966c2da7ef admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.583816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a582c-28e1-40e8-8a5c-a30dc79a90d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:50.584990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a582c-28e1-40e8-8a5c-a30dc79a90d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.585513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a582c-28e1-40e8-8a5c-a30dc79a90d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.586049 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6a582c-28e1-40e8-8a5c-a30dc79a90d7 admin admin] PATH_INFO: `/v3/projects/def59a58cbb44dcfbc78c2391ce391e0/users/e1ecf6b555b84197a392dcd115e73c79/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.624918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a582c-28e1-40e8-8a5c-a30dc79a90d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=def59a58cbb44dcfbc78c2391ce391e0, user_id=e1ecf6b555b84197a392dcd115e73c79, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:50.636681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6a582c-28e1-40e8-8a5c-a30dc79a90d7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:50.656073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5ab9b1bfc8b407088bb55d280434d0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:50.658331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5ab9b1bfc8b407088bb55d280434d0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:50.666274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1132/2258] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:50 2022] PUT /identity/v3/projects/def59a58cbb44dcfbc78c2391ce391e0/users/e1ecf6b555b84197a392dcd115e73c79/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:39:50.670986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a582c-28e1-40e8-8a5c-a30dc79a90d7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:50.681225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5ab9b1bfc8b407088bb55d280434d0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:50.700502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5ab9b1bfc8b407088bb55d280434d0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:50.766273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0b561f20-e9a4-484a-b0b3-98b2df3176ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5ab9b1bfc8b407088bb55d280434d0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:50.776195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1127/2259] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:50 2022] DELETE /identity/v3/users/f5ab9b1bfc8b407088bb55d280434d0a => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:50.780602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f557dd-661c-4fb3-a623-83d321c33d84 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:50.782767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f557dd-661c-4fb3-a623-83d321c33d84 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:50.791427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f557dd-661c-4fb3-a623-83d321c33d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:50.857398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b3f557dd-661c-4fb3-a623-83d321c33d84 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:50.864542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b3f557dd-661c-4fb3-a623-83d321c33d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:50.867906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6a582c-28e1-40e8-8a5c-a30dc79a90d7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:50.891394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:51.100454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:51.101371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:51.101987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:51.102422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:51.103564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:51.108566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:51.172572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1128/2260] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:51.175114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1133/2261] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:51.181718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f557dd-661c-4fb3-a623-83d321c33d84 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:51.183394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b3f557dd-661c-4fb3-a623-83d321c33d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:51.199299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:51.202657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:51.210103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f557dd-661c-4fb3-a623-83d321c33d84 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:51.228986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e442b-49ab-42c1-b1a3-72184e90943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:51.230283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e442b-49ab-42c1-b1a3-72184e90943d admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:51.230283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e442b-49ab-42c1-b1a3-72184e90943d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:51.230283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e442b-49ab-42c1-b1a3-72184e90943d admin admin] PATH_INFO: `/v3/projects/def59a58cbb44dcfbc78c2391ce391e0/users/e1ecf6b555b84197a392dcd115e73c79/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:51.233166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:51.238894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e442b-49ab-42c1-b1a3-72184e90943d admin admin] RBAC: Authorizing `identity:create_grant(project_id=def59a58cbb44dcfbc78c2391ce391e0, user_id=e1ecf6b555b84197a392dcd115e73c79, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:51.241696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e442b-49ab-42c1-b1a3-72184e90943d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:51.271642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1129/2262] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:51 2022] PUT /identity/v3/projects/def59a58cbb44dcfbc78c2391ce391e0/users/e1ecf6b555b84197a392dcd115e73c79/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:51.395819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd85653e-39e7-47f9-99b4-1f2d75857b38 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:51.515948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:51.517697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:51.518088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:51.519050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:51.637123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d5267-1b01-45d9-95e4-1c383e3af771 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:51.637355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d5267-1b01-45d9-95e4-1c383e3af771 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:51.637664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d5267-1b01-45d9-95e4-1c383e3af771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:51.668952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:51.670636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:51.683852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1134/2263] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:51.711668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a25d5267-1b01-45d9-95e4-1c383e3af771 None None] MFA Rules not processed for user `e1382292b43945b4871382306f36772a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:51.713244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a25d5267-1b01-45d9-95e4-1c383e3af771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:51.812562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1130/2264] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:51.827825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:51.829911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:52.002078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17750c-f816-4010-b2b4-1f2e52493398 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:52.027339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f2fd-9427-41d9-a4d5-80e660e3b100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:52.029065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f2fd-9427-41d9-a4d5-80e660e3b100 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:52.029426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f2fd-9427-41d9-a4d5-80e660e3b100 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:52.029732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1f2fd-9427-41d9-a4d5-80e660e3b100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:52.061387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1f2fd-9427-41d9-a4d5-80e660e3b100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:52.065425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1f2fd-9427-41d9-a4d5-80e660e3b100 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:52.074347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:52.102117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1135/2265] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:52.595040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d5267-1b01-45d9-95e4-1c383e3af771 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:52.596681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a25d5267-1b01-45d9-95e4-1c383e3af771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:52.621168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d5267-1b01-45d9-95e4-1c383e3af771 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:52.627374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:52.629013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:52.629505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:52.630062 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] PATH_INFO: `/v3/projects/9ec37801f8264a9f87b0e7ae0b78cf09` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:52.632152 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec37801f8264a9f87b0e7ae0b78cf09)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:52.643537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:52.782668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec37801f8264a9f87b0e7ae0b78cf09', 'request_id': 'req-934cfb56-6307-4a24-bb06-0a3fafb3cf65'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:52.796416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec37801f8264a9f87b0e7ae0b78cf09', 'request_id': 'req-934cfb56-6307-4a24-bb06-0a3fafb3cf65'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:52.807303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec37801f8264a9f87b0e7ae0b78cf09', 'request_id': 'req-934cfb56-6307-4a24-bb06-0a3fafb3cf65'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:52.829520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] The token cache is being invalidate because project 9ec37801f8264a9f87b0e7ae0b78cf09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:52.829871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:52.830593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:52.837325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f2fd-9427-41d9-a4d5-80e660e3b100 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:52.842074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1131/2266] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:52 2022] DELETE /identity/v3/projects/9ec37801f8264a9f87b0e7ae0b78cf09 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:52.863749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1f2fd-9427-41d9-a4d5-80e660e3b100 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:53.073009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:53.073902 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:53.074355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:53.074798 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] PATH_INFO: `/v3/users/b71053f8e96b412fa771927d7b275537` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:53.076164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b71053f8e96b412fa771927d7b275537)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:53.089151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:53.234441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b71053f8e96b412fa771927d7b275537'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:53.268886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b71053f8e96b412fa771927d7b275537'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:53.274107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b71053f8e96b412fa771927d7b275537'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:53.316822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b71053f8e96b412fa771927d7b275537'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:53.327127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-bda97471-177e-4115-ba93-1fb4f365f930 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b71053f8e96b412fa771927d7b275537'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:53.349211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1136/2267] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:52 2022] DELETE /identity/v3/users/b71053f8e96b412fa771927d7b275537 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:55.337301 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:55.339922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:55.402078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934cfb56-6307-4a24-bb06-0a3fafb3cf65 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:55.430629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:55.658106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:55.658639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:55.658997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:55.659248 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] PATH_INFO: `/v3/projects/93adc9bb079c493eb70484c871f628d4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:55.662343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93adc9bb079c493eb70484c871f628d4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:55.670399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:55.782983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93adc9bb079c493eb70484c871f628d4', 'request_id': 'req-36eed771-b0da-436d-9a73-02b769be4763'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:55.794891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93adc9bb079c493eb70484c871f628d4', 'request_id': 'req-36eed771-b0da-436d-9a73-02b769be4763'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:55.816548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93adc9bb079c493eb70484c871f628d4', 'request_id': 'req-36eed771-b0da-436d-9a73-02b769be4763'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:55.834543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] The token cache is being invalidate because project 93adc9bb079c493eb70484c871f628d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:55.835218 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:55.836164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-36eed771-b0da-436d-9a73-02b769be4763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:55.838899 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1132/2268] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:55 2022] DELETE /identity/v3/projects/93adc9bb079c493eb70484c871f628d4 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:55.843667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60733b-3e23-4c4f-b743-ad5fc3af0dca None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:55.844490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60733b-3e23-4c4f-b743-ad5fc3af0dca None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:55.844855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60733b-3e23-4c4f-b743-ad5fc3af0dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:55.884065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5a60733b-3e23-4c4f-b743-ad5fc3af0dca None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:55.886144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5a60733b-3e23-4c4f-b743-ad5fc3af0dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:56.045151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1137/2269] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:56.046948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec105-95fe-4dad-b1a1-0668381d6bf7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.047303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec105-95fe-4dad-b1a1-0668381d6bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.047568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dec105-95fe-4dad-b1a1-0668381d6bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.093080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-92dec105-95fe-4dad-b1a1-0668381d6bf7 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:56.102208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-92dec105-95fe-4dad-b1a1-0668381d6bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:56.124736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1133/2270] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:56.126627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60733b-3e23-4c4f-b743-ad5fc3af0dca None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:56.141360 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60733b-3e23-4c4f-b743-ad5fc3af0dca None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:56.152738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:56.153604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.153953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.154185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.154932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:39:56.155248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:56.160101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:56.196769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1138/2271] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:39:56.202720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dec105-95fe-4dad-b1a1-0668381d6bf7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:56.228985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dec105-95fe-4dad-b1a1-0668381d6bf7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:56.234336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db225-05f7-4f97-88db-77b34ae0d7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:56.234993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db225-05f7-4f97-88db-77b34ae0d7c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.235281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db225-05f7-4f97-88db-77b34ae0d7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.235637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7db225-05f7-4f97-88db-77b34ae0d7c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.236293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7db225-05f7-4f97-88db-77b34ae0d7c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:56.239775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7db225-05f7-4f97-88db-77b34ae0d7c6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:56.328013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1134/2272] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:56 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:56.332992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:56.357797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cda4c-713c-42ca-b17e-4d2e4bf4e3a6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:56.368160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:56.496486 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85a2e-d7b8-45fa-af6b-cb95d78745f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:56.497127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85a2e-d7b8-45fa-af6b-cb95d78745f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.498625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85a2e-d7b8-45fa-af6b-cb95d78745f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.498953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc85a2e-d7b8-45fa-af6b-cb95d78745f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.499617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc85a2e-d7b8-45fa-af6b-cb95d78745f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:56.507239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc85a2e-d7b8-45fa-af6b-cb95d78745f8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:56.572715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1139/2273] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:56 2022] POST /identity/v3/users => generated 291 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:56.576906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db225-05f7-4f97-88db-77b34ae0d7c6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:56.590990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7db225-05f7-4f97-88db-77b34ae0d7c6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:56.606220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd6d1a-8c29-4cb2-8932-442a8c1b8937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:56.607174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd6d1a-8c29-4cb2-8932-442a8c1b8937 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.607866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd6d1a-8c29-4cb2-8932-442a8c1b8937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.608382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd6d1a-8c29-4cb2-8932-442a8c1b8937 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.610600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd6d1a-8c29-4cb2-8932-442a8c1b8937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:56.613394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd6d1a-8c29-4cb2-8932-442a8c1b8937 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:56.626849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1135/2274] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:56.631273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85a2e-d7b8-45fa-af6b-cb95d78745f8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:56.642795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc85a2e-d7b8-45fa-af6b-cb95d78745f8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:56.649673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b154b8-1278-47a5-abd1-b03b0f92420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:56.650269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b154b8-1278-47a5-abd1-b03b0f92420f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.650558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b154b8-1278-47a5-abd1-b03b0f92420f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.650953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b154b8-1278-47a5-abd1-b03b0f92420f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.651633 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b154b8-1278-47a5-abd1-b03b0f92420f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:56.653446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b154b8-1278-47a5-abd1-b03b0f92420f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:56.692013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1140/2275] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:56.696505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd6d1a-8c29-4cb2-8932-442a8c1b8937 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:56.718866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd6d1a-8c29-4cb2-8932-442a8c1b8937 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:56.734419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720820c2-193a-4e24-8bd7-e4d3e1580ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:56.735501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720820c2-193a-4e24-8bd7-e4d3e1580ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.735986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720820c2-193a-4e24-8bd7-e4d3e1580ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.736460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720820c2-193a-4e24-8bd7-e4d3e1580ee0 admin admin] PATH_INFO: `/v3/projects/f140be2644f442c898dd19811a5211a9/users/1daf1a2e4e5e4babad4a3fa9654eb486/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.761597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720820c2-193a-4e24-8bd7-e4d3e1580ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f140be2644f442c898dd19811a5211a9, user_id=1daf1a2e4e5e4babad4a3fa9654eb486, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:56.765920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720820c2-193a-4e24-8bd7-e4d3e1580ee0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:56.803848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1136/2276] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:56 2022] PUT /identity/v3/projects/f140be2644f442c898dd19811a5211a9/users/1daf1a2e4e5e4babad4a3fa9654eb486/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:56.815309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607efd6-0d39-4f0f-9ca7-8bdcd1c61173 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:56.815826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607efd6-0d39-4f0f-9ca7-8bdcd1c61173 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:56.816597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607efd6-0d39-4f0f-9ca7-8bdcd1c61173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:56.860730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e607efd6-0d39-4f0f-9ca7-8bdcd1c61173 None None] MFA Rules not processed for user `1daf1a2e4e5e4babad4a3fa9654eb486`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:56.863698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e607efd6-0d39-4f0f-9ca7-8bdcd1c61173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:56.961413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1141/2277] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:56.970679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720820c2-193a-4e24-8bd7-e4d3e1580ee0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.089477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:57.134135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c710f-b966-46a3-8f93-1ce92aa18f05 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.134427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c710f-b966-46a3-8f93-1ce92aa18f05 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.134719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318c710f-b966-46a3-8f93-1ce92aa18f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.154017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720820c2-193a-4e24-8bd7-e4d3e1580ee0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.157803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-318c710f-b966-46a3-8f93-1ce92aa18f05 None None] MFA Rules not processed for user `e1382292b43945b4871382306f36772a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:57.159298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-318c710f-b966-46a3-8f93-1ce92aa18f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:57.163870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.164699 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.167370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.168089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.168915 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.171113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.235569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1137/2278] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:39:56 2022] POST /identity/v3/projects => generated 381 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:57.235569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.236271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:57.251163 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1142/2279] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:57.252158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c710f-b966-46a3-8f93-1ce92aa18f05 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.277748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318c710f-b966-46a3-8f93-1ce92aa18f05 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.317184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:57.361098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627fea9c-bb7c-4c98-a9c3-02b458f9c8d4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.373840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.375318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.375602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.375871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] PATH_INFO: `/v3/users/dde0d8991b144052bb522a4c89a2bce0` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.380111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde0d8991b144052bb522a4c89a2bce0)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.383211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.419191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd542b1-e184-4918-8c5c-d3b7fdaa2025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.419813 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd542b1-e184-4918-8c5c-d3b7fdaa2025 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.420091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd542b1-e184-4918-8c5c-d3b7fdaa2025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.420359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd542b1-e184-4918-8c5c-d3b7fdaa2025 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.422350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd542b1-e184-4918-8c5c-d3b7fdaa2025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.424350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd542b1-e184-4918-8c5c-d3b7fdaa2025 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.483336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1143/2280] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:39:57 2022] POST /identity/v3/users => generated 297 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:39:57.486083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd542b1-e184-4918-8c5c-d3b7fdaa2025 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.506650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd542b1-e184-4918-8c5c-d3b7fdaa2025 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.508438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde0d8991b144052bb522a4c89a2bce0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:57.509375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde0d8991b144052bb522a4c89a2bce0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:57.519296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7e543-989a-4b67-80a9-4dc5591fb7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.519919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e543-989a-4b67-80a9-4dc5591fb7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.520260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e543-989a-4b67-80a9-4dc5591fb7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.520536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e543-989a-4b67-80a9-4dc5591fb7d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.521397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7e543-989a-4b67-80a9-4dc5591fb7d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.526042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde0d8991b144052bb522a4c89a2bce0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:57.531304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7e543-989a-4b67-80a9-4dc5591fb7d1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.537202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde0d8991b144052bb522a4c89a2bce0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:57.557800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1144/2281] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:57.563639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7e543-989a-4b67-80a9-4dc5591fb7d1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.564474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-ba17891f-1fd8-4a45-bfff-5e5600b57a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde0d8991b144052bb522a4c89a2bce0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:57.579328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7e543-989a-4b67-80a9-4dc5591fb7d1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.589706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1138/2282] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:39:57 2022] DELETE /identity/v3/users/dde0d8991b144052bb522a4c89a2bce0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:57.593400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698e0b0-50f7-424c-a96d-658e885da75f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.593755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698e0b0-50f7-424c-a96d-658e885da75f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.594128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698e0b0-50f7-424c-a96d-658e885da75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.597477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.598190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.598476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.598760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] PATH_INFO: `/v3/projects/3257e6c3991544309fa797b45fef37ec/users/e9576f848ac94a19a0f7a0819a009965/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.628668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3257e6c3991544309fa797b45fef37ec, user_id=e9576f848ac94a19a0f7a0819a009965, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.631612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:57.650637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9698e0b0-50f7-424c-a96d-658e885da75f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:57.653278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9698e0b0-50f7-424c-a96d-658e885da75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:57.677779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1145/2283] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:57 2022] PUT /identity/v3/projects/3257e6c3991544309fa797b45fef37ec/users/e9576f848ac94a19a0f7a0819a009965/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:57.684543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.693003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:57.772485 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:57.849105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1139/2284] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:39:57.864022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698e0b0-50f7-424c-a96d-658e885da75f None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:57.865514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9698e0b0-50f7-424c-a96d-658e885da75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:57.937171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c1eb3-b63f-463d-8cae-76f67bd79af6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:57.953263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc74a3-c130-443c-9664-565f454d12d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:57.953991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc74a3-c130-443c-9664-565f454d12d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:57.954342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc74a3-c130-443c-9664-565f454d12d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:57.954733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc74a3-c130-443c-9664-565f454d12d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:57.956062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc74a3-c130-443c-9664-565f454d12d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:57.962023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddc74a3-c130-443c-9664-565f454d12d2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.004237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1146/2285] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/roles => generated 1420 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:39:58.014812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc74a3-c130-443c-9664-565f454d12d2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:58.044348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc74a3-c130-443c-9664-565f454d12d2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.050969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698e0b0-50f7-424c-a96d-658e885da75f None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.058563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444189a-f1c0-474f-8fb9-3960e8d81923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.059478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444189a-f1c0-474f-8fb9-3960e8d81923 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.060356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444189a-f1c0-474f-8fb9-3960e8d81923 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.061249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444189a-f1c0-474f-8fb9-3960e8d81923 admin admin] PATH_INFO: `/v3/projects/3257e6c3991544309fa797b45fef37ec/users/e9576f848ac94a19a0f7a0819a009965/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.064662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.066255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444189a-f1c0-474f-8fb9-3960e8d81923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3257e6c3991544309fa797b45fef37ec, user_id=e9576f848ac94a19a0f7a0819a009965, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.066986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.067370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.068650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.072352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9444189a-f1c0-474f-8fb9-3960e8d81923 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.089526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.093670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.101033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1147/2286] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:39:58 2022] PUT /identity/v3/projects/3257e6c3991544309fa797b45fef37ec/users/e9576f848ac94a19a0f7a0819a009965/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:39:58.112713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec233df-5239-415a-988d-16b18a5434ce None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.116252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1140/2287] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:39:58.116539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec233df-5239-415a-988d-16b18a5434ce None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.116960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec233df-5239-415a-988d-16b18a5434ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.225345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3ec233df-5239-415a-988d-16b18a5434ce None None] MFA Rules not processed for user `e9576f848ac94a19a0f7a0819a009965`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:39:58.227145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ec233df-5239-415a-988d-16b18a5434ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:58.314581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:58.386310 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1148/2288] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:39:58 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:39:58.398295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:58.400714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:58.539869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312e206-8085-46bc-8a82-5cf6b33d21a5 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.627294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.628827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.629238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.630074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.646029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:58.651637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:58.672981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1141/2289] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:58 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:58.907870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec233df-5239-415a-988d-16b18a5434ce None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:58.910048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ec233df-5239-415a-988d-16b18a5434ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:58.932160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec233df-5239-415a-988d-16b18a5434ce None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:58.945123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19bb0aa-9ad6-4bee-8d6f-ee5b4be50033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:58.945789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb0aa-9ad6-4bee-8d6f-ee5b4be50033 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:58.946102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb0aa-9ad6-4bee-8d6f-ee5b4be50033 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:58.946340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19bb0aa-9ad6-4bee-8d6f-ee5b4be50033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:58.948595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c19bb0aa-9ad6-4bee-8d6f-ee5b4be50033 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:59.093331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bb0aa-9ad6-4bee-8d6f-ee5b4be50033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.094819 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19bb0aa-9ad6-4bee-8d6f-ee5b4be50033 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.124107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1149/2290] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:39:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:39:59.142102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:39:59.144209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:39:59.287631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:39:59.348721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad00c0-cc44-4905-8317-bb5a66a59908 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:39:59.367795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:39:59.367795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:39:59.368053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:39:59.375947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] PATH_INFO: `/v3/projects/1c43f06120314e99a313f6ed1b6f5682` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:39:59.378157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c43f06120314e99a313f6ed1b6f5682)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:39:59.380105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:39:59.586828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c43f06120314e99a313f6ed1b6f5682', 'request_id': 'req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:59.603278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c43f06120314e99a313f6ed1b6f5682', 'request_id': 'req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:59.644097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c43f06120314e99a313f6ed1b6f5682', 'request_id': 'req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:59.702745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] The token cache is being invalidate because project 1c43f06120314e99a313f6ed1b6f5682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:39:59.704424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:59.709417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:39:59.730410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1142/2291] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:39:59 2022] DELETE /identity/v3/projects/1c43f06120314e99a313f6ed1b6f5682 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:00.164048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8757a-4fbf-4538-a1f0-0bcf7b01a42e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:00.166135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8757a-4fbf-4538-a1f0-0bcf7b01a42e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:00.166135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8757a-4fbf-4538-a1f0-0bcf7b01a42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:00.202456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-61c8757a-4fbf-4538-a1f0-0bcf7b01a42e None None] MFA Rules not processed for user `e1ecf6b555b84197a392dcd115e73c79`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:00.203900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-61c8757a-4fbf-4538-a1f0-0bcf7b01a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:00.334016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1150/2292] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:00.343940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:00.343940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:00.494295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee65cf5-f39a-4d07-8fd3-fd0ce5b9144b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:00.505634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3712f0-3b2b-4639-a810-9bedd0236cff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:00.506836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3712f0-3b2b-4639-a810-9bedd0236cff service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:00.507387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3712f0-3b2b-4639-a810-9bedd0236cff service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:00.507986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3712f0-3b2b-4639-a810-9bedd0236cff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:00.510646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cd3712f0-3b2b-4639-a810-9bedd0236cff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:00.596486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3712f0-3b2b-4639-a810-9bedd0236cff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:00.598777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3712f0-3b2b-4639-a810-9bedd0236cff service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:00.610631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1143/2293] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:01.603083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8757a-4fbf-4538-a1f0-0bcf7b01a42e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:01.605393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-61c8757a-4fbf-4538-a1f0-0bcf7b01a42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:01.707115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8757a-4fbf-4538-a1f0-0bcf7b01a42e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:01.711048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:01.711669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:01.711955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:01.712408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:01.717237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:01.740759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:01.811459 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:01.813338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:01.844741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1151/2294] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:02.107723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360a85e-1753-4583-8637-fac1ce85bd9f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:02.108231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360a85e-1753-4583-8637-fac1ce85bd9f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:02.108445 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360a85e-1753-4583-8637-fac1ce85bd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:02.149416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6360a85e-1753-4583-8637-fac1ce85bd9f None None] MFA Rules not processed for user `af6775ff7d674767af4e7d19290cd684`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:02.151466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6360a85e-1753-4583-8637-fac1ce85bd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:02.169026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1144/2295] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:02.497096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:02.500343 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:02.649563 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56891d2c-e458-49d1-9957-8164c94b3e6b service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:02.657163 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:02.659234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:02.659850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:02.660408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] PATH_INFO: `/v3/users/1daf1a2e4e5e4babad4a3fa9654eb486` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:02.661833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1daf1a2e4e5e4babad4a3fa9654eb486)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:02.664777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:02.750037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1daf1a2e4e5e4babad4a3fa9654eb486'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:02.771607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1daf1a2e4e5e4babad4a3fa9654eb486'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:02.772851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1daf1a2e4e5e4babad4a3fa9654eb486'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:02.785600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1daf1a2e4e5e4babad4a3fa9654eb486'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:02.796758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1daf1a2e4e5e4babad4a3fa9654eb486'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:02.819499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1152/2296] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:02 2022] DELETE /identity/v3/users/1daf1a2e4e5e4babad4a3fa9654eb486 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:02.827110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3f1c8-a314-4f19-ad1e-aca4773add87 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:02.827110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3f1c8-a314-4f19-ad1e-aca4773add87 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:02.827269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3f1c8-a314-4f19-ad1e-aca4773add87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:02.850052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:02.867098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1cd3f1c8-a314-4f19-ad1e-aca4773add87 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:02.868329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1cd3f1c8-a314-4f19-ad1e-aca4773add87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:03.021376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1145/2297] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:03.034087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:03.035762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:03.136239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:03.204932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d39a1d-a47a-42f9-9402-570d9af53cee admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:03.224028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a44ca-ef33-450a-9b9d-fc0b9e60b383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:03.225438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a44ca-ef33-450a-9b9d-fc0b9e60b383 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:03.226286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a44ca-ef33-450a-9b9d-fc0b9e60b383 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:03.226807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a44ca-ef33-450a-9b9d-fc0b9e60b383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:03.240062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a44ca-ef33-450a-9b9d-fc0b9e60b383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:03.241783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a44ca-ef33-450a-9b9d-fc0b9e60b383 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:03.270554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1153/2298] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:03.838090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3f1c8-a314-4f19-ad1e-aca4773add87 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:03.842310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1cd3f1c8-a314-4f19-ad1e-aca4773add87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:03.856846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3f1c8-a314-4f19-ad1e-aca4773add87 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:03.868061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:03.869503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:03.870770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:03.871321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] PATH_INFO: `/v3/projects/f140be2644f442c898dd19811a5211a9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:03.880996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f140be2644f442c898dd19811a5211a9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:03.885629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:03.977659 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f140be2644f442c898dd19811a5211a9', 'request_id': 'req-5211c874-75a6-4e70-b0dd-c03f6d3818e2'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:03.996596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f140be2644f442c898dd19811a5211a9', 'request_id': 'req-5211c874-75a6-4e70-b0dd-c03f6d3818e2'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.010330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f140be2644f442c898dd19811a5211a9', 'request_id': 'req-5211c874-75a6-4e70-b0dd-c03f6d3818e2'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.026768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] The token cache is being invalidate because project f140be2644f442c898dd19811a5211a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:04.027059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.027972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.031034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1146/2299] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:03 2022] DELETE /identity/v3/projects/f140be2644f442c898dd19811a5211a9 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:04.035874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a44ca-ef33-450a-9b9d-fc0b9e60b383 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:04.046918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a44ca-ef33-450a-9b9d-fc0b9e60b383 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:04.155731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:04.156606 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.157098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.157522 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] PATH_INFO: `/v3/users/e9576f848ac94a19a0f7a0819a009965` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.159943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9576f848ac94a19a0f7a0819a009965)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:04.162915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:04.260998 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9576f848ac94a19a0f7a0819a009965'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.277732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9576f848ac94a19a0f7a0819a009965'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.278772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9576f848ac94a19a0f7a0819a009965'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.294757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9576f848ac94a19a0f7a0819a009965'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.308815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e11d8abe-a209-4f53-b0cb-d50923eb53b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9576f848ac94a19a0f7a0819a009965'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.322947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1154/2300] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:04 2022] DELETE /identity/v3/users/e9576f848ac94a19a0f7a0819a009965 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:40:04.740907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:04.742517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:04.762777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211c874-75a6-4e70-b0dd-c03f6d3818e2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:04.842747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:04.843565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.843811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.844090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] PATH_INFO: `/v3/projects/3257e6c3991544309fa797b45fef37ec` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.845410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3257e6c3991544309fa797b45fef37ec)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:04.847406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:04.883200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:04.903847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3257e6c3991544309fa797b45fef37ec', 'request_id': 'req-b50217b2-3959-49e0-90a0-586798b18140'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.910379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3257e6c3991544309fa797b45fef37ec', 'request_id': 'req-b50217b2-3959-49e0-90a0-586798b18140'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.919360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3257e6c3991544309fa797b45fef37ec', 'request_id': 'req-b50217b2-3959-49e0-90a0-586798b18140'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.937271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] The token cache is being invalidate because project 3257e6c3991544309fa797b45fef37ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:04.937465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.938134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-b50217b2-3959-49e0-90a0-586798b18140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:04.940256 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1147/2301] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:04 2022] DELETE /identity/v3/projects/3257e6c3991544309fa797b45fef37ec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:04.945417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7e814-fb90-4e70-9f94-a99b71541a76 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:04.945683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7e814-fb90-4e70-9f94-a99b71541a76 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:04.945976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7e814-fb90-4e70-9f94-a99b71541a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:04.965455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-51a7e814-fb90-4e70-9f94-a99b71541a76 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:04.966778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-51a7e814-fb90-4e70-9f94-a99b71541a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:05.025749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:05.040997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1155/2302] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:05.050309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16719a55-72a9-43a1-a357-2e7026a506f0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.050977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16719a55-72a9-43a1-a357-2e7026a506f0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.051414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16719a55-72a9-43a1-a357-2e7026a506f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.081003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-16719a55-72a9-43a1-a357-2e7026a506f0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:05.082296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-16719a55-72a9-43a1-a357-2e7026a506f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:05.090409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1148/2303] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:05.095376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7e814-fb90-4e70-9f94-a99b71541a76 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.106521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7e814-fb90-4e70-9f94-a99b71541a76 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.112537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.113165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.113448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.113723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.114440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:05.114748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.116371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.129891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1156/2304] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:40:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:40:05.134374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16719a55-72a9-43a1-a357-2e7026a506f0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.144973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16719a55-72a9-43a1-a357-2e7026a506f0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.150667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9707197-f05a-42cb-b213-7fe3fdf5c7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.151290 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707197-f05a-42cb-b213-7fe3fdf5c7df admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.151573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707197-f05a-42cb-b213-7fe3fdf5c7df admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.151853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707197-f05a-42cb-b213-7fe3fdf5c7df admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.152498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9707197-f05a-42cb-b213-7fe3fdf5c7df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.154750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9707197-f05a-42cb-b213-7fe3fdf5c7df admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.186497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1149/2305] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:40:05 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:05.191758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.203609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65092994-e290-4001-96ef-544f0742fdc4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.301106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba9df5-f387-43ed-a607-159d2df13447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.301780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9df5-f387-43ed-a607-159d2df13447 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.302461 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9df5-f387-43ed-a607-159d2df13447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.302898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba9df5-f387-43ed-a607-159d2df13447 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.303596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba9df5-f387-43ed-a607-159d2df13447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.305614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba9df5-f387-43ed-a607-159d2df13447 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.329405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1157/2306] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:05 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:40:05.334336 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9707197-f05a-42cb-b213-7fe3fdf5c7df admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.345426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9707197-f05a-42cb-b213-7fe3fdf5c7df admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.351088 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cc5cc-cec7-4706-be9d-beebcf2b6954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.351996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc5cc-cec7-4706-be9d-beebcf2b6954 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.352342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc5cc-cec7-4706-be9d-beebcf2b6954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.352685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3cc5cc-cec7-4706-be9d-beebcf2b6954 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.353417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc5cc-cec7-4706-be9d-beebcf2b6954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.355183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3cc5cc-cec7-4706-be9d-beebcf2b6954 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.367154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1150/2307] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:05.371225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba9df5-f387-43ed-a607-159d2df13447 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.382980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba9df5-f387-43ed-a607-159d2df13447 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.388040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95c3a7-c86f-41a1-b1f7-6667fde89098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.388671 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95c3a7-c86f-41a1-b1f7-6667fde89098 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.388972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95c3a7-c86f-41a1-b1f7-6667fde89098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.389228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95c3a7-c86f-41a1-b1f7-6667fde89098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.390413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95c3a7-c86f-41a1-b1f7-6667fde89098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.392071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95c3a7-c86f-41a1-b1f7-6667fde89098 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.409974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1158/2308] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:05.411820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cc5cc-cec7-4706-be9d-beebcf2b6954 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.423380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3cc5cc-cec7-4706-be9d-beebcf2b6954 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.430577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f8a8-e7c9-451e-ae14-84b6b772b58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.431399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f8a8-e7c9-451e-ae14-84b6b772b58f admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.431687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f8a8-e7c9-451e-ae14-84b6b772b58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.431982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498f8a8-e7c9-451e-ae14-84b6b772b58f admin admin] PATH_INFO: `/v3/projects/2148a8aa214b4f92aa270606e6b46c39/users/8e5bb567e3be4e50897e7975d193caec/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.451701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f8a8-e7c9-451e-ae14-84b6b772b58f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2148a8aa214b4f92aa270606e6b46c39, user_id=8e5bb567e3be4e50897e7975d193caec, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.454529 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7498f8a8-e7c9-451e-ae14-84b6b772b58f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:05.473994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1151/2309] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:40:05 2022] PUT /identity/v3/projects/2148a8aa214b4f92aa270606e6b46c39/users/8e5bb567e3be4e50897e7975d193caec/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:05.482154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9192792-773c-4e73-9c81-b1707c416c32 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.482634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9192792-773c-4e73-9c81-b1707c416c32 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.482995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9192792-773c-4e73-9c81-b1707c416c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.520559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c9192792-773c-4e73-9c81-b1707c416c32 None None] MFA Rules not processed for user `8e5bb567e3be4e50897e7975d193caec`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:05.521807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c9192792-773c-4e73-9c81-b1707c416c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:05.731002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1159/2310] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:05.735689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f8a8-e7c9-451e-ae14-84b6b772b58f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:05.918282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498f8a8-e7c9-451e-ae14-84b6b772b58f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:05.949349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67a75-af3d-4a3e-a433-64980fa0ff28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:05.949619 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67a75-af3d-4a3e-a433-64980fa0ff28 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:05.950051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67a75-af3d-4a3e-a433-64980fa0ff28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:05.950768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e67a75-af3d-4a3e-a433-64980fa0ff28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:05.951148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e67a75-af3d-4a3e-a433-64980fa0ff28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:05.953176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e67a75-af3d-4a3e-a433-64980fa0ff28 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:06.019639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1152/2311] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:40:05 2022] POST /identity/v3/projects => generated 383 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:06.020844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9192792-773c-4e73-9c81-b1707c416c32 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:06.033220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9192792-773c-4e73-9c81-b1707c416c32 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:06.106979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:06.125281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02737-fe7d-40d1-ab50-a799f5628a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:06.125928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02737-fe7d-40d1-ab50-a799f5628a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.126204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02737-fe7d-40d1-ab50-a799f5628a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.126477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba02737-fe7d-40d1-ab50-a799f5628a6a admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.127832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba02737-fe7d-40d1-ab50-a799f5628a6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:06.135966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba02737-fe7d-40d1-ab50-a799f5628a6a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:06.161301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1160/2312] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:06 2022] POST /identity/v3/users => generated 298 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:40:06.165614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67a75-af3d-4a3e-a433-64980fa0ff28 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:06.183455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e67a75-af3d-4a3e-a433-64980fa0ff28 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:06.191018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c971-f006-4738-b1b9-0bfa3d62861e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:06.191911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c971-f006-4738-b1b9-0bfa3d62861e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.192443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c971-f006-4738-b1b9-0bfa3d62861e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.192869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7c971-f006-4738-b1b9-0bfa3d62861e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.193770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7c971-f006-4738-b1b9-0bfa3d62861e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:06.195809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7c971-f006-4738-b1b9-0bfa3d62861e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:06.213139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1153/2313] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:06.218162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02737-fe7d-40d1-ab50-a799f5628a6a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:06.229124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba02737-fe7d-40d1-ab50-a799f5628a6a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:06.254698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93e076-dff2-4f14-92a0-93e2a0eb4dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:06.254936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93e076-dff2-4f14-92a0-93e2a0eb4dbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.255089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93e076-dff2-4f14-92a0-93e2a0eb4dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.255374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93e076-dff2-4f14-92a0-93e2a0eb4dbe admin admin] PATH_INFO: `/v3/projects/7abd034d3cc74bf0b400a333c553d43b/users/5b2ffce6949c45a7b39e12fcb4e1ef05/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.276879 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93e076-dff2-4f14-92a0-93e2a0eb4dbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abd034d3cc74bf0b400a333c553d43b, user_id=5b2ffce6949c45a7b39e12fcb4e1ef05, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:06.279639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93e076-dff2-4f14-92a0-93e2a0eb4dbe admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:06.295952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1161/2314] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:40:06 2022] PUT /identity/v3/projects/7abd034d3cc74bf0b400a333c553d43b/users/5b2ffce6949c45a7b39e12fcb4e1ef05/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:40:06.300497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c971-f006-4738-b1b9-0bfa3d62861e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:06.321733 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7c971-f006-4738-b1b9-0bfa3d62861e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:06.365788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:06.415494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953af5c3-cd9d-4bca-aa82-04a59ca0916b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:06.416400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af5c3-cd9d-4bca-aa82-04a59ca0916b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.416831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af5c3-cd9d-4bca-aa82-04a59ca0916b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.418141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953af5c3-cd9d-4bca-aa82-04a59ca0916b admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.418946 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953af5c3-cd9d-4bca-aa82-04a59ca0916b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:06.420840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953af5c3-cd9d-4bca-aa82-04a59ca0916b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:06.448811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93e076-dff2-4f14-92a0-93e2a0eb4dbe admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:06.460092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1154/2315] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:06 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:06.465924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93e076-dff2-4f14-92a0-93e2a0eb4dbe admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:06.471948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:06.472827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.473214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.473590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] PATH_INFO: `/v3/projects/7abd034d3cc74bf0b400a333c553d43b/users/5b2ffce6949c45a7b39e12fcb4e1ef05/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.476188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abd034d3cc74bf0b400a333c553d43b, user_id=5b2ffce6949c45a7b39e12fcb4e1ef05, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:06.479911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:06.519003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1162/2316] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:40:06 2022] PUT /identity/v3/projects/7abd034d3cc74bf0b400a333c553d43b/users/5b2ffce6949c45a7b39e12fcb4e1ef05/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:06.520575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442b3d-6a23-46d2-8d93-140b08cea6af None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.520967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442b3d-6a23-46d2-8d93-140b08cea6af None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.521350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4442b3d-6a23-46d2-8d93-140b08cea6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.593508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c4442b3d-6a23-46d2-8d93-140b08cea6af None None] MFA Rules not processed for user `5b2ffce6949c45a7b39e12fcb4e1ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:06.594918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c4442b3d-6a23-46d2-8d93-140b08cea6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:06.714332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1155/2317] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:06.727760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:06.730062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:06.818424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e7495-f624-4604-8812-02bcb371fb57 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:06.828849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e534a9-6107-4411-8eda-8ca394375597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:06.829500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e534a9-6107-4411-8eda-8ca394375597 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.829783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e534a9-6107-4411-8eda-8ca394375597 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.830767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e534a9-6107-4411-8eda-8ca394375597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:06.843775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e534a9-6107-4411-8eda-8ca394375597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:06.845299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e534a9-6107-4411-8eda-8ca394375597 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:06.856847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1163/2318] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:06.945432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4442b3d-6a23-46d2-8d93-140b08cea6af None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:06.957456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4442b3d-6a23-46d2-8d93-140b08cea6af None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:06.964215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8a9b5b-176b-479e-be3d-bdb746109d15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:06.964215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a9b5b-176b-479e-be3d-bdb746109d15 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:06.964215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a9b5b-176b-479e-be3d-bdb746109d15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:06.964215 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8a9b5b-176b-479e-be3d-bdb746109d15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:07.044324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a9b5b-176b-479e-be3d-bdb746109d15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:07.045887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8a9b5b-176b-479e-be3d-bdb746109d15 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:07.061852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1156/2319] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:07.419699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e534a9-6107-4411-8eda-8ca394375597 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:07.499398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e534a9-6107-4411-8eda-8ca394375597 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:07.504585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:07.505211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:07.505495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:07.505768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] PATH_INFO: `/v3/users/8e5bb567e3be4e50897e7975d193caec` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:07.507032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e5bb567e3be4e50897e7975d193caec)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:07.508949 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:07.560435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e5bb567e3be4e50897e7975d193caec'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:07.562963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:07.582238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e5bb567e3be4e50897e7975d193caec'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:07.582993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e5bb567e3be4e50897e7975d193caec'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:07.592001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e5bb567e3be4e50897e7975d193caec'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:07.599897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e5bb567e3be4e50897e7975d193caec'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:07.605971 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1164/2320] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:07 2022] DELETE /identity/v3/users/8e5bb567e3be4e50897e7975d193caec => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:07.610548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83c63-b2ab-44b5-84dd-498247fc94c9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:07.610833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83c63-b2ab-44b5-84dd-498247fc94c9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:07.611118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83c63-b2ab-44b5-84dd-498247fc94c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:07.634196 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a3e83c63-b2ab-44b5-84dd-498247fc94c9 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:07.635465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a3e83c63-b2ab-44b5-84dd-498247fc94c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:07.686704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:07.703896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1157/2321] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:07.715032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:07.716517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:07.801752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666d2e4-d645-4e35-92c2-398e6975c5a3 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:07.811494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d710777-ca55-42d6-9f39-c64d3d92dfce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:07.812301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710777-ca55-42d6-9f39-c64d3d92dfce service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:07.812694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710777-ca55-42d6-9f39-c64d3d92dfce service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:07.813095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d710777-ca55-42d6-9f39-c64d3d92dfce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:07.825511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d710777-ca55-42d6-9f39-c64d3d92dfce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:07.827403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d710777-ca55-42d6-9f39-c64d3d92dfce service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:07.846916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1165/2322] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:08.173103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e83c63-b2ab-44b5-84dd-498247fc94c9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:08.175810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a3e83c63-b2ab-44b5-84dd-498247fc94c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:08.195284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e83c63-b2ab-44b5-84dd-498247fc94c9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:08.203151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:08.204103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:08.204622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:08.205117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] PATH_INFO: `/v3/projects/2148a8aa214b4f92aa270606e6b46c39` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:08.207074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2148a8aa214b4f92aa270606e6b46c39)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:08.209503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:08.303842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2148a8aa214b4f92aa270606e6b46c39', 'request_id': 'req-c510e7b3-11de-4f7a-8a10-cf82a73d9295'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.313564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2148a8aa214b4f92aa270606e6b46c39', 'request_id': 'req-c510e7b3-11de-4f7a-8a10-cf82a73d9295'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.327050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2148a8aa214b4f92aa270606e6b46c39', 'request_id': 'req-c510e7b3-11de-4f7a-8a10-cf82a73d9295'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.347232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] The token cache is being invalidate because project 2148a8aa214b4f92aa270606e6b46c39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:08.347549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.348262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.352671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1158/2323] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:08 2022] DELETE /identity/v3/projects/2148a8aa214b4f92aa270606e6b46c39 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:08.354560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d710777-ca55-42d6-9f39-c64d3d92dfce service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:08.367962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d710777-ca55-42d6-9f39-c64d3d92dfce service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:08.463090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:08.463620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:08.463902 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:08.464248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] PATH_INFO: `/v3/users/5b2ffce6949c45a7b39e12fcb4e1ef05` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:08.466148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b2ffce6949c45a7b39e12fcb4e1ef05)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:08.471594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:08.551793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b2ffce6949c45a7b39e12fcb4e1ef05'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.574058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b2ffce6949c45a7b39e12fcb4e1ef05'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.574840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b2ffce6949c45a7b39e12fcb4e1ef05'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.583882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b2ffce6949c45a7b39e12fcb4e1ef05'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.585364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:08.594929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-97896c9f-a389-44ac-86a9-6f60a364b3c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b2ffce6949c45a7b39e12fcb4e1ef05'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:08.602673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1166/2324] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:08 2022] DELETE /identity/v3/users/5b2ffce6949c45a7b39e12fcb4e1ef05 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:40:08.919013 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:08.920563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:08.934851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c510e7b3-11de-4f7a-8a10-cf82a73d9295 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:08.993726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:08.994425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:08.994716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:08.994989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] PATH_INFO: `/v3/projects/7abd034d3cc74bf0b400a333c553d43b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:08.996127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abd034d3cc74bf0b400a333c553d43b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:08.998081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:09.044953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abd034d3cc74bf0b400a333c553d43b', 'request_id': 'req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:09.050403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abd034d3cc74bf0b400a333c553d43b', 'request_id': 'req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:09.057618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abd034d3cc74bf0b400a333c553d43b', 'request_id': 'req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:09.069074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] The token cache is being invalidate because project 7abd034d3cc74bf0b400a333c553d43b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:09.069363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:09.070026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-1f73d3b4-b29d-4209-8f5d-df2dbf841f70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:09.071497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1159/2325] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:08 2022] DELETE /identity/v3/projects/7abd034d3cc74bf0b400a333c553d43b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:09.076381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ba3a-b578-4d06-bd2a-74bf5a3fc2dc None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.076634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ba3a-b578-4d06-bd2a-74bf5a3fc2dc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.076909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c10ba3a-b578-4d06-bd2a-74bf5a3fc2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.098465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4c10ba3a-b578-4d06-bd2a-74bf5a3fc2dc None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:09.099909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4c10ba3a-b578-4d06-bd2a-74bf5a3fc2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:09.161210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1167/2326] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:09.169342 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ca897-bb4f-4a13-a944-6ba2e747a072 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.169643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ca897-bb4f-4a13-a944-6ba2e747a072 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.169924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680ca897-bb4f-4a13-a944-6ba2e747a072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.178304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:09.192851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-680ca897-bb4f-4a13-a944-6ba2e747a072 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:09.194085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-680ca897-bb4f-4a13-a944-6ba2e747a072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:09.202155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1160/2327] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:09.206376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10ba3a-b578-4d06-bd2a-74bf5a3fc2dc None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:09.216918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c10ba3a-b578-4d06-bd2a-74bf5a3fc2dc None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:09.221910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:09.222537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.222806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.223078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.223758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:09.224067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:09.225719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:09.237757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1168/2328] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:09.242098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ca897-bb4f-4a13-a944-6ba2e747a072 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:09.252595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680ca897-bb4f-4a13-a944-6ba2e747a072 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:09.257300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28281efa-b8b8-4bf0-ad86-c03bda1d578e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:09.257919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28281efa-b8b8-4bf0-ad86-c03bda1d578e admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.258204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28281efa-b8b8-4bf0-ad86-c03bda1d578e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.258480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28281efa-b8b8-4bf0-ad86-c03bda1d578e admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.259097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28281efa-b8b8-4bf0-ad86-c03bda1d578e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:09.260997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28281efa-b8b8-4bf0-ad86-c03bda1d578e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:09.291439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1161/2329] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:40:09 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:09.296154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:09.311585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0080e52c-77e7-406e-99da-1336ae265ee8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:09.367911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e24c-d8bc-49da-912a-6b304c86b5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:09.368548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e24c-d8bc-49da-912a-6b304c86b5ec admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.368838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e24c-d8bc-49da-912a-6b304c86b5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.369105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647e24c-d8bc-49da-912a-6b304c86b5ec admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.369744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647e24c-d8bc-49da-912a-6b304c86b5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:09.371690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647e24c-d8bc-49da-912a-6b304c86b5ec admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:09.397247 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1169/2330] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:09 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:40:09.398540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28281efa-b8b8-4bf0-ad86-c03bda1d578e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:09.409182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28281efa-b8b8-4bf0-ad86-c03bda1d578e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:09.413929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf80b5-3d3e-4b7c-b002-802cc6c9370a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:09.414540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf80b5-3d3e-4b7c-b002-802cc6c9370a admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.414822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf80b5-3d3e-4b7c-b002-802cc6c9370a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.415101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf80b5-3d3e-4b7c-b002-802cc6c9370a admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.415754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf80b5-3d3e-4b7c-b002-802cc6c9370a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:09.417670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf80b5-3d3e-4b7c-b002-802cc6c9370a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:09.428679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1162/2331] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:40:09.432740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e24c-d8bc-49da-912a-6b304c86b5ec admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:09.443458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647e24c-d8bc-49da-912a-6b304c86b5ec admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:09.448041 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0de14-b91c-459a-8835-538b4bc632a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:09.448630 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0de14-b91c-459a-8835-538b4bc632a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.448911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0de14-b91c-459a-8835-538b4bc632a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.449185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0de14-b91c-459a-8835-538b4bc632a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.449837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0de14-b91c-459a-8835-538b4bc632a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:09.451535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0de14-b91c-459a-8835-538b4bc632a6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:09.465765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1170/2332] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:09.468225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf80b5-3d3e-4b7c-b002-802cc6c9370a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:09.479250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf80b5-3d3e-4b7c-b002-802cc6c9370a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:09.484343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:09.485023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.485305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.485577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] PATH_INFO: `/v3/projects/60fb8247b6cd4d9d84c555935db188ba/users/b631570e32714241b1df5337aca4836b/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.504539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fb8247b6cd4d9d84c555935db188ba, user_id=b631570e32714241b1df5337aca4836b, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:09.507277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:09.525957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1163/2333] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:40:09 2022] PUT /identity/v3/projects/60fb8247b6cd4d9d84c555935db188ba/users/b631570e32714241b1df5337aca4836b/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:09.538196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcff7-71f5-4d2a-90cd-b5872531f48e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.538722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcff7-71f5-4d2a-90cd-b5872531f48e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.539197 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ebcff7-71f5-4d2a-90cd-b5872531f48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.578703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-13ebcff7-71f5-4d2a-90cd-b5872531f48e None None] MFA Rules not processed for user `b631570e32714241b1df5337aca4836b`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:09.579443 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-13ebcff7-71f5-4d2a-90cd-b5872531f48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:09.638244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:09.669909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1171/2334] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:09.678594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:09.680434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:09.742967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b7bf9b-7fab-4d62-a987-7b4f1a394c7a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:09.752987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228794c-7765-4357-8cdf-5199033e03be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:09.753622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228794c-7765-4357-8cdf-5199033e03be service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:09.753935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228794c-7765-4357-8cdf-5199033e03be service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:09.754368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6228794c-7765-4357-8cdf-5199033e03be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:09.779595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228794c-7765-4357-8cdf-5199033e03be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:09.781078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6228794c-7765-4357-8cdf-5199033e03be service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:09.792627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1164/2335] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:15.413172 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7176-3c7b-4759-b985-e1b27c7a9619 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:15.413720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7176-3c7b-4759-b985-e1b27c7a9619 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:15.413720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6db7176-3c7b-4759-b985-e1b27c7a9619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:15.433516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f6db7176-3c7b-4759-b985-e1b27c7a9619 None None] MFA Rules not processed for user `266a34590c4645ffa4c1c4afe3a9970d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:15.434748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f6db7176-3c7b-4759-b985-e1b27c7a9619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:15.494779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1172/2336] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:19.788442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=52,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:23.852515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228794c-7765-4357-8cdf-5199033e03be service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:23.960841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6228794c-7765-4357-8cdf-5199033e03be service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:23.963357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:23.964135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:23.964930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:23.964930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] PATH_INFO: `/v3/users/b631570e32714241b1df5337aca4836b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:23.966201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b631570e32714241b1df5337aca4836b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:23.968390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:24.021138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b631570e32714241b1df5337aca4836b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.021901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b631570e32714241b1df5337aca4836b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.029370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b631570e32714241b1df5337aca4836b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.037106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b631570e32714241b1df5337aca4836b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.050666 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b631570e32714241b1df5337aca4836b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.057144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1165/2337] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:23 2022] DELETE /identity/v3/users/b631570e32714241b1df5337aca4836b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:24.061851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c2e90-ea44-4ea1-9d96-0b1bb011ba57 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.062422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c2e90-ea44-4ea1-9d96-0b1bb011ba57 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.062657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c2e90-ea44-4ea1-9d96-0b1bb011ba57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.082773 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e92c2e90-ea44-4ea1-9d96-0b1bb011ba57 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:24.083999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e92c2e90-ea44-4ea1-9d96-0b1bb011ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:24.145989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1173/2338] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:24.155849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:24.157328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:24.229682 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fd2ca-affb-41dd-8b58-7cd5dda969eb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:24.233431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99e8b4-9f98-4325-8241-2bf833f77928 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:24.234096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99e8b4-9f98-4325-8241-2bf833f77928 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.234381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99e8b4-9f98-4325-8241-2bf833f77928 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.234657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99e8b4-9f98-4325-8241-2bf833f77928 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.245747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99e8b4-9f98-4325-8241-2bf833f77928 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:24.247230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99e8b4-9f98-4325-8241-2bf833f77928 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:24.257962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1166/2339] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:40:24.647016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c2e90-ea44-4ea1-9d96-0b1bb011ba57 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:24.648580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e92c2e90-ea44-4ea1-9d96-0b1bb011ba57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:24.663561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c2e90-ea44-4ea1-9d96-0b1bb011ba57 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:24.670855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:24.671645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.671988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.672327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] PATH_INFO: `/v3/projects/60fb8247b6cd4d9d84c555935db188ba` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.674627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fb8247b6cd4d9d84c555935db188ba)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:24.676748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:24.734407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fb8247b6cd4d9d84c555935db188ba', 'request_id': 'req-b641110d-47cf-4b81-9e3d-897d1a959352'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.741482 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fb8247b6cd4d9d84c555935db188ba', 'request_id': 'req-b641110d-47cf-4b81-9e3d-897d1a959352'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.749922 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fb8247b6cd4d9d84c555935db188ba', 'request_id': 'req-b641110d-47cf-4b81-9e3d-897d1a959352'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.762257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] The token cache is being invalidate because project 60fb8247b6cd4d9d84c555935db188ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:24.762553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.763196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b641110d-47cf-4b81-9e3d-897d1a959352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:24.764684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1174/2340] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:24 2022] DELETE /identity/v3/projects/60fb8247b6cd4d9d84c555935db188ba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:24.770278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccc612-3b1a-4864-9f0c-8cd1a1d45e66 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.770565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccc612-3b1a-4864-9f0c-8cd1a1d45e66 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.770841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ccc612-3b1a-4864-9f0c-8cd1a1d45e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.797115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-65ccc612-3b1a-4864-9f0c-8cd1a1d45e66 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:24.798387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-65ccc612-3b1a-4864-9f0c-8cd1a1d45e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:24.818629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:24.868939 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1167/2341] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:24.877241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3e05-b9d6-454b-aae6-de71c528ba7a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.877848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3e05-b9d6-454b-aae6-de71c528ba7a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.878164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd3e05-b9d6-454b-aae6-de71c528ba7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.901498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3cfd3e05-b9d6-454b-aae6-de71c528ba7a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:24.903075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3cfd3e05-b9d6-454b-aae6-de71c528ba7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:24.911770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1175/2342] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:24.918292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccc612-3b1a-4864-9f0c-8cd1a1d45e66 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:24.928517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ccc612-3b1a-4864-9f0c-8cd1a1d45e66 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:24.933428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:24.934072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.934360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.934636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.935461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:24.935770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:24.937382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:24.949695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1168/2343] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:24.954093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd3e05-b9d6-454b-aae6-de71c528ba7a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:24.964099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd3e05-b9d6-454b-aae6-de71c528ba7a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:24.968762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6ca53-2c94-4b86-9632-2fbe4b14c1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:24.969361 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6ca53-2c94-4b86-9632-2fbe4b14c1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:24.969640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6ca53-2c94-4b86-9632-2fbe4b14c1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:24.969995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6ca53-2c94-4b86-9632-2fbe4b14c1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:24.971291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6ca53-2c94-4b86-9632-2fbe4b14c1a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:24.973193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6ca53-2c94-4b86-9632-2fbe4b14c1a6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:24.978656 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:25.015931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1176/2344] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:40:24 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:25.021677 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.035700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e04ef52-0456-4621-a3cd-019cf1201f0e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:25.124277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:25.124910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.125488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.125774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.126640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:25.128905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:25.158681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1169/2345] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:25 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:25.164400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6ca53-2c94-4b86-9632-2fbe4b14c1a6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.180929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6ca53-2c94-4b86-9632-2fbe4b14c1a6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:25.185699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98398486-c8df-4d44-8cf1-3d00cdab16f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:25.186346 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98398486-c8df-4d44-8cf1-3d00cdab16f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.186626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98398486-c8df-4d44-8cf1-3d00cdab16f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.186899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98398486-c8df-4d44-8cf1-3d00cdab16f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.187553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98398486-c8df-4d44-8cf1-3d00cdab16f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:25.189868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98398486-c8df-4d44-8cf1-3d00cdab16f4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:25.196788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.199160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:25.200868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1177/2346] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:40:25.205376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98398486-c8df-4d44-8cf1-3d00cdab16f4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.221254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98398486-c8df-4d44-8cf1-3d00cdab16f4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:25.222449 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d1acb-06dc-4d9e-9f55-b89a4875858e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:25.226281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7def16-1e7e-4f19-ac8b-32806d85d9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:25.226846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7def16-1e7e-4f19-ac8b-32806d85d9ca admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.227123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7def16-1e7e-4f19-ac8b-32806d85d9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.227429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7def16-1e7e-4f19-ac8b-32806d85d9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.228030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7def16-1e7e-4f19-ac8b-32806d85d9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:25.229423 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:25.229932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7def16-1e7e-4f19-ac8b-32806d85d9ca admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:25.230145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.230436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.231626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] PATH_INFO: `/v3/users/ef2588ba5cda41d6a5c06ebe9b888ee6` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.233297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2588ba5cda41d6a5c06ebe9b888ee6)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:25.238927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:25.260600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1178/2347] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:25.265082 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7def16-1e7e-4f19-ac8b-32806d85d9ca admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.288240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7def16-1e7e-4f19-ac8b-32806d85d9ca admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:25.299921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d886ddcf-79f8-4ec6-bb7e-41e8ed6dec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:25.304404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ddcf-79f8-4ec6-bb7e-41e8ed6dec6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.304722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ddcf-79f8-4ec6-bb7e-41e8ed6dec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.305006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d886ddcf-79f8-4ec6-bb7e-41e8ed6dec6e admin admin] PATH_INFO: `/v3/projects/1cb20b6b8d684701a67004ff442bcf42/users/95becb238da644cd8af557eb8bca210e/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.324887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2588ba5cda41d6a5c06ebe9b888ee6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.325735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2588ba5cda41d6a5c06ebe9b888ee6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.331521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886ddcf-79f8-4ec6-bb7e-41e8ed6dec6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cb20b6b8d684701a67004ff442bcf42, user_id=95becb238da644cd8af557eb8bca210e, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:25.334288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d886ddcf-79f8-4ec6-bb7e-41e8ed6dec6e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:25.339559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2588ba5cda41d6a5c06ebe9b888ee6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.352437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2588ba5cda41d6a5c06ebe9b888ee6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.365899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1179/2348] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:40:25 2022] PUT /identity/v3/projects/1cb20b6b8d684701a67004ff442bcf42/users/95becb238da644cd8af557eb8bca210e/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:25.367361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2588ba5cda41d6a5c06ebe9b888ee6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.368121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fae09-f3fb-450d-a1f7-ab9c9847fccd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.369135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fae09-f3fb-450d-a1f7-ab9c9847fccd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.369135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82fae09-f3fb-450d-a1f7-ab9c9847fccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.379412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1170/2349] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:25 2022] DELETE /identity/v3/users/ef2588ba5cda41d6a5c06ebe9b888ee6 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:25.408201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b82fae09-f3fb-450d-a1f7-ab9c9847fccd None None] MFA Rules not processed for user `95becb238da644cd8af557eb8bca210e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:25.410419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b82fae09-f3fb-450d-a1f7-ab9c9847fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:25.502122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1180/2350] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:25 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:25.513708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.515182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:25.531105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:25.582654 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b075308-9321-4105-8469-b4b4e29892b4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:25.586346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:25.586965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.587254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.587530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.596602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:25.598081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:25.609178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1171/2351] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:25 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:25.638564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fae09-f3fb-450d-a1f7-ab9c9847fccd None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.640073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b82fae09-f3fb-450d-a1f7-ab9c9847fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:25.748005 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82fae09-f3fb-450d-a1f7-ab9c9847fccd None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:25.757307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:25.758007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.758295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.758569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] PATH_INFO: `/v3/users/95becb238da644cd8af557eb8bca210e` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.759889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95becb238da644cd8af557eb8bca210e)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:25.762134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:25.772536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.774092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:25.806343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62168c0f-ebab-4ac3-8b91-ff76d065ff09 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:25.809897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:25.816718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:25.817528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.817823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.818127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] PATH_INFO: `/v3/projects/c8065d8b71884f349316422ec8a3d116` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.826183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8065d8b71884f349316422ec8a3d116)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:25.828330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:25.831226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95becb238da644cd8af557eb8bca210e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.845228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95becb238da644cd8af557eb8bca210e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.846058 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95becb238da644cd8af557eb8bca210e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.856490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95becb238da644cd8af557eb8bca210e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.867250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-d2db5d58-126c-4419-8365-eb3dd34cb408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95becb238da644cd8af557eb8bca210e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.875929 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1181/2352] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:25 2022] DELETE /identity/v3/users/95becb238da644cd8af557eb8bca210e => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:25.880715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138b96e-c8be-4957-a4c2-a73224203229 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:25.881067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138b96e-c8be-4957-a4c2-a73224203229 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:25.881406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138b96e-c8be-4957-a4c2-a73224203229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:25.889708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8065d8b71884f349316422ec8a3d116', 'request_id': 'req-245c3ebc-0899-477e-a553-fbbaa9dd4508'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.899884 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8065d8b71884f349316422ec8a3d116', 'request_id': 'req-245c3ebc-0899-477e-a553-fbbaa9dd4508'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.908552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7138b96e-c8be-4957-a4c2-a73224203229 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:25.908797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8065d8b71884f349316422ec8a3d116', 'request_id': 'req-245c3ebc-0899-477e-a553-fbbaa9dd4508'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.910279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7138b96e-c8be-4957-a4c2-a73224203229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:25.921049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] The token cache is being invalidate because project c8065d8b71884f349316422ec8a3d116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:25.921341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.922017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:25.924044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1172/2353] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:25 2022] DELETE /identity/v3/projects/c8065d8b71884f349316422ec8a3d116 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:40:25.928639 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.929972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:25.987340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1182/2354] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:40:25.997601 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138b96e-c8be-4957-a4c2-a73224203229 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:25.999184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7138b96e-c8be-4957-a4c2-a73224203229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:26.021069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c3ebc-0899-477e-a553-fbbaa9dd4508 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:26.035030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:26.036788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:26.037255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:26.037535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] PATH_INFO: `/v3/users/2db6daa8353741a89f575e8edee5abc6` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:26.039010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2db6daa8353741a89f575e8edee5abc6)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:26.041569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:26.074204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138b96e-c8be-4957-a4c2-a73224203229 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:26.080567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14922-626d-4b02-a8f0-03df0bdd675b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:26.081239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14922-626d-4b02-a8f0-03df0bdd675b service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:26.081520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14922-626d-4b02-a8f0-03df0bdd675b service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:26.081787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df14922-626d-4b02-a8f0-03df0bdd675b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:26.095246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df14922-626d-4b02-a8f0-03df0bdd675b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:26.097231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df14922-626d-4b02-a8f0-03df0bdd675b service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:26.111151 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1183/2355] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:26.115653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:26.129674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2db6daa8353741a89f575e8edee5abc6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.134307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2db6daa8353741a89f575e8edee5abc6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.151597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2db6daa8353741a89f575e8edee5abc6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.165307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2db6daa8353741a89f575e8edee5abc6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.183981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2db6daa8353741a89f575e8edee5abc6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.194159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1173/2356] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:25 2022] DELETE /identity/v3/users/2db6daa8353741a89f575e8edee5abc6 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:26.529150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14922-626d-4b02-a8f0-03df0bdd675b service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:26.562374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df14922-626d-4b02-a8f0-03df0bdd675b service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:26.618926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:26.621553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:26.700430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:26.730707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:26.732181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:26.732181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:26.732181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] PATH_INFO: `/v3/projects/bdfee5e453654a4d92db3d60e0e613cb` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:26.734573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdfee5e453654a4d92db3d60e0e613cb)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:26.739862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:26.771437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a43241-9ed0-46eb-93b2-49ea1d122076 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:26.776329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:26.776976 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:26.777260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:26.777541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] PATH_INFO: `/v3/projects/1cb20b6b8d684701a67004ff442bcf42` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:26.778745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cb20b6b8d684701a67004ff442bcf42)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:26.780739 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:26.840438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cb20b6b8d684701a67004ff442bcf42', 'request_id': 'req-f134fa51-5d2d-4264-80f6-b6d16fd20439'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.848684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cb20b6b8d684701a67004ff442bcf42', 'request_id': 'req-f134fa51-5d2d-4264-80f6-b6d16fd20439'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.858170 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdfee5e453654a4d92db3d60e0e613cb', 'request_id': 'req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.858783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cb20b6b8d684701a67004ff442bcf42', 'request_id': 'req-f134fa51-5d2d-4264-80f6-b6d16fd20439'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.873392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdfee5e453654a4d92db3d60e0e613cb', 'request_id': 'req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.889205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] The token cache is being invalidate because project 1cb20b6b8d684701a67004ff442bcf42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:26.889978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.891051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f134fa51-5d2d-4264-80f6-b6d16fd20439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.894452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1174/2357] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:26 2022] DELETE /identity/v3/projects/1cb20b6b8d684701a67004ff442bcf42 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:40:26.903053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdfee5e453654a4d92db3d60e0e613cb', 'request_id': 'req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.922039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] The token cache is being invalidate because project bdfee5e453654a4d92db3d60e0e613cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:26.922548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.923657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5e8cbefc-8f1a-4007-b737-4df2b893f2a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:26.929703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1184/2358] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:26 2022] DELETE /identity/v3/projects/bdfee5e453654a4d92db3d60e0e613cb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:26.936225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e92bcb-da8e-4485-9252-0c3329f635b6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:26.936504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e92bcb-da8e-4485-9252-0c3329f635b6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:26.936991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e92bcb-da8e-4485-9252-0c3329f635b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:26.965291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-78e92bcb-da8e-4485-9252-0c3329f635b6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:26.966516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-78e92bcb-da8e-4485-9252-0c3329f635b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:27.036491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:27.091530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1175/2359] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:27.099756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacb33-2ef7-4c34-a3c0-3adeb5cbeeda None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.100044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacb33-2ef7-4c34-a3c0-3adeb5cbeeda None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.100328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cacb33-2ef7-4c34-a3c0-3adeb5cbeeda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.145344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-59cacb33-2ef7-4c34-a3c0-3adeb5cbeeda None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:27.146923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-59cacb33-2ef7-4c34-a3c0-3adeb5cbeeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:27.163247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e92bcb-da8e-4485-9252-0c3329f635b6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.168574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1185/2360] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:40:27.175755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e92bcb-da8e-4485-9252-0c3329f635b6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.181176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.181981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.182280 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.182559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.183409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:27.183788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.185722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.200499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1176/2361] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:40:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:27.205263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacb33-2ef7-4c34-a3c0-3adeb5cbeeda None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.214641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cacb33-2ef7-4c34-a3c0-3adeb5cbeeda None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.219906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da3a0-2062-44e1-b58a-639e47fa7bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.220323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da3a0-2062-44e1-b58a-639e47fa7bde admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.220597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da3a0-2062-44e1-b58a-639e47fa7bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.220866 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7da3a0-2062-44e1-b58a-639e47fa7bde admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.221494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7da3a0-2062-44e1-b58a-639e47fa7bde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.223434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7da3a0-2062-44e1-b58a-639e47fa7bde admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.262112 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1186/2362] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:40:27 2022] POST /identity/v3/projects => generated 359 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:27.265296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.281029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95dccfa-6a85-46a0-8ac5-826d1101c21c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.354046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736b48-29a3-4852-8f23-549f14af389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.354736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736b48-29a3-4852-8f23-549f14af389a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.355083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736b48-29a3-4852-8f23-549f14af389a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.355424 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736b48-29a3-4852-8f23-549f14af389a admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.356120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91736b48-29a3-4852-8f23-549f14af389a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.358170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91736b48-29a3-4852-8f23-549f14af389a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.393203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1177/2363] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:27 2022] POST /identity/v3/users => generated 280 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:27.397285 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da3a0-2062-44e1-b58a-639e47fa7bde admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.420948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7da3a0-2062-44e1-b58a-639e47fa7bde admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.427979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b75a-a03d-4d7d-a7f5-977c92588b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.429506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b75a-a03d-4d7d-a7f5-977c92588b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.430030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b75a-a03d-4d7d-a7f5-977c92588b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.430452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938b75a-a03d-4d7d-a7f5-977c92588b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.431076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938b75a-a03d-4d7d-a7f5-977c92588b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.434096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938b75a-a03d-4d7d-a7f5-977c92588b32 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.453364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736b48-29a3-4852-8f23-549f14af389a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.454161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1187/2364] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:27.467048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736b48-29a3-4852-8f23-549f14af389a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.473554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16201f7c-f528-44db-92ed-b54f3005e121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.474141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16201f7c-f528-44db-92ed-b54f3005e121 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.474425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16201f7c-f528-44db-92ed-b54f3005e121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.474781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16201f7c-f528-44db-92ed-b54f3005e121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.475360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16201f7c-f528-44db-92ed-b54f3005e121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.477084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16201f7c-f528-44db-92ed-b54f3005e121 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.489751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1178/2365] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:40:27.493821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b75a-a03d-4d7d-a7f5-977c92588b32 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.504337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938b75a-a03d-4d7d-a7f5-977c92588b32 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.509095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.509753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.510073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.510358 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] PATH_INFO: `/v3/projects/a1e06f4614e646ce8a9059bc9cf2fd5d/users/d66786ac94194aed8241486abf78de45/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.529107 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1e06f4614e646ce8a9059bc9cf2fd5d, user_id=d66786ac94194aed8241486abf78de45, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.532066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.549590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1188/2366] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:40:27 2022] PUT /identity/v3/projects/a1e06f4614e646ce8a9059bc9cf2fd5d/users/d66786ac94194aed8241486abf78de45/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:27.562179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7be5-2823-44c0-a0a1-2ae60e0e8e5d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.562179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7be5-2823-44c0-a0a1-2ae60e0e8e5d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.562179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695f7be5-2823-44c0-a0a1-2ae60e0e8e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.594643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-695f7be5-2823-44c0-a0a1-2ae60e0e8e5d None None] MFA Rules not processed for user `d66786ac94194aed8241486abf78de45`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:27.596436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-695f7be5-2823-44c0-a0a1-2ae60e0e8e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:27.669928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1179/2367] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:27.706546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.708445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:27.779518 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbd35b-edcc-4d8c-ba5b-2be6ddb4cb12 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.783985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a18c34-70ee-4970-8a77-d2154e7dd0d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.785654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18c34-70ee-4970-8a77-d2154e7dd0d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.785976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18c34-70ee-4970-8a77-d2154e7dd0d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.786255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18c34-70ee-4970-8a77-d2154e7dd0d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.809040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a18c34-70ee-4970-8a77-d2154e7dd0d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.810576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a18c34-70ee-4970-8a77-d2154e7dd0d0 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.822735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1189/2368] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:27 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:40:27.838933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f7be5-2823-44c0-a0a1-2ae60e0e8e5d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:27.893730 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:27.914849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695f7be5-2823-44c0-a0a1-2ae60e0e8e5d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:27.919972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:27.920707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:27.921059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:27.921402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] PATH_INFO: `/v3/users/d66786ac94194aed8241486abf78de45` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:27.922676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66786ac94194aed8241486abf78de45)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:27.925225 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:27.974800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66786ac94194aed8241486abf78de45'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:27.975488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66786ac94194aed8241486abf78de45'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:27.983898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66786ac94194aed8241486abf78de45'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:27.991702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66786ac94194aed8241486abf78de45'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:28.011763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66786ac94194aed8241486abf78de45'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:28.022130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1180/2369] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:27 2022] DELETE /identity/v3/users/d66786ac94194aed8241486abf78de45 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:28.039344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a803fdf-83ef-468b-b517-2c096474cfee None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:28.039650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a803fdf-83ef-468b-b517-2c096474cfee None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:28.039903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a803fdf-83ef-468b-b517-2c096474cfee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:28.063607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4a803fdf-83ef-468b-b517-2c096474cfee None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:28.065003 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a803fdf-83ef-468b-b517-2c096474cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:28.078490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:28.128500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1190/2370] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:28.138474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:28.139896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:28.198719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5549d07b-e27e-45f1-8512-d77fee579494 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:28.202362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce100a-1e13-4a6f-8c73-c478b24f76b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:28.202963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce100a-1e13-4a6f-8c73-c478b24f76b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:28.203246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce100a-1e13-4a6f-8c73-c478b24f76b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:28.203520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce100a-1e13-4a6f-8c73-c478b24f76b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:28.212987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce100a-1e13-4a6f-8c73-c478b24f76b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:28.214461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce100a-1e13-4a6f-8c73-c478b24f76b4 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:28.223876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1181/2371] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:28.528732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a803fdf-83ef-468b-b517-2c096474cfee None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:28.530360 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a803fdf-83ef-468b-b517-2c096474cfee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:28.547183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a803fdf-83ef-468b-b517-2c096474cfee None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:28.560721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:28.561394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:28.561681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:28.562729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] PATH_INFO: `/v3/projects/a1e06f4614e646ce8a9059bc9cf2fd5d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:28.563332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1e06f4614e646ce8a9059bc9cf2fd5d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:28.565574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:28.622342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1e06f4614e646ce8a9059bc9cf2fd5d', 'request_id': 'req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:28.630101 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1e06f4614e646ce8a9059bc9cf2fd5d', 'request_id': 'req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:28.639056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1e06f4614e646ce8a9059bc9cf2fd5d', 'request_id': 'req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:28.650604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] The token cache is being invalidate because project a1e06f4614e646ce8a9059bc9cf2fd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:28.650898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:28.651541 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0ad3e4ca-6028-40fb-975d-8ab136e4fc7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:28.653237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1191/2372] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:28 2022] DELETE /identity/v3/projects/a1e06f4614e646ce8a9059bc9cf2fd5d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:28.658614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee176b-8026-472d-a4d7-f3d37aaf0565 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:28.658917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee176b-8026-472d-a4d7-f3d37aaf0565 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:28.659168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ee176b-8026-472d-a4d7-f3d37aaf0565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:28.679977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a1ee176b-8026-472d-a4d7-f3d37aaf0565 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:28.681185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a1ee176b-8026-472d-a4d7-f3d37aaf0565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:28.752077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1182/2373] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:28.760286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479cf1-2172-424a-bd40-db9b2839a537 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:28.760703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479cf1-2172-424a-bd40-db9b2839a537 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:28.761057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0479cf1-2172-424a-bd40-db9b2839a537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:28.792102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a0479cf1-2172-424a-bd40-db9b2839a537 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:28.793481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a0479cf1-2172-424a-bd40-db9b2839a537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:28.803751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1192/2374] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:28.808053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee176b-8026-472d-a4d7-f3d37aaf0565 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:28.814854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:28.819958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ee176b-8026-472d-a4d7-f3d37aaf0565 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:28.826258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:28.827015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:28.827661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:28.828001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:28.828771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:28.829191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:28.830907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:28.846208 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1183/2375] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:40:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:28.847359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0479cf1-2172-424a-bd40-db9b2839a537 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:28.856562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0479cf1-2172-424a-bd40-db9b2839a537 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:28.862009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3538bf1-6ec5-4657-a0b7-3ea65eedb453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:28.862603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538bf1-6ec5-4657-a0b7-3ea65eedb453 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:28.862881 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538bf1-6ec5-4657-a0b7-3ea65eedb453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:28.863205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3538bf1-6ec5-4657-a0b7-3ea65eedb453 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:28.863769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3538bf1-6ec5-4657-a0b7-3ea65eedb453 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:28.865658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3538bf1-6ec5-4657-a0b7-3ea65eedb453 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:28.898308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1193/2376] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:40:28 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:28.899665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:28.910955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153289c2-1d87-4fd8-a71e-660fce4e45c8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:28.972209 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662d8cf-cb79-4b2f-8b3c-d88a331296c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:28.972825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662d8cf-cb79-4b2f-8b3c-d88a331296c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:28.973117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662d8cf-cb79-4b2f-8b3c-d88a331296c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:28.973391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662d8cf-cb79-4b2f-8b3c-d88a331296c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:28.974061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662d8cf-cb79-4b2f-8b3c-d88a331296c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:28.976038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662d8cf-cb79-4b2f-8b3c-d88a331296c6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:29.005071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1184/2377] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:28 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:29.006455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3538bf1-6ec5-4657-a0b7-3ea65eedb453 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:29.017240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3538bf1-6ec5-4657-a0b7-3ea65eedb453 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:29.023511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b634cc-6ea5-415d-92e9-aec8e1257d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:29.023511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b634cc-6ea5-415d-92e9-aec8e1257d20 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:29.023511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b634cc-6ea5-415d-92e9-aec8e1257d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:29.023853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b634cc-6ea5-415d-92e9-aec8e1257d20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:29.024642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b634cc-6ea5-415d-92e9-aec8e1257d20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:29.026462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b634cc-6ea5-415d-92e9-aec8e1257d20 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:29.039075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1194/2378] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:29.043296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662d8cf-cb79-4b2f-8b3c-d88a331296c6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:29.060037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662d8cf-cb79-4b2f-8b3c-d88a331296c6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:29.067295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f839e37e-689b-4fab-8a4f-8eda6e13b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:29.067918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e37e-689b-4fab-8a4f-8eda6e13b92d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:29.068233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e37e-689b-4fab-8a4f-8eda6e13b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:29.068514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f839e37e-689b-4fab-8a4f-8eda6e13b92d admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:29.069371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e37e-689b-4fab-8a4f-8eda6e13b92d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:29.072200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f839e37e-689b-4fab-8a4f-8eda6e13b92d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:29.086562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1185/2379] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:29 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:29.090304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b634cc-6ea5-415d-92e9-aec8e1257d20 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:29.101792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b634cc-6ea5-415d-92e9-aec8e1257d20 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:29.106696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:29.107382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:29.107665 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:29.107945 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] PATH_INFO: `/v3/projects/5120688742094893bfe0fff350262ef5/users/2dcf7b4fce0e40838b0cb9f3de19296c/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:29.123354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5120688742094893bfe0fff350262ef5, user_id=2dcf7b4fce0e40838b0cb9f3de19296c, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:29.126654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:29.140719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1195/2380] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:40:29 2022] PUT /identity/v3/projects/5120688742094893bfe0fff350262ef5/users/2dcf7b4fce0e40838b0cb9f3de19296c/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:40:29.152612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3d38-126b-4443-8bff-46085c0bd5e8 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:29.152909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3d38-126b-4443-8bff-46085c0bd5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:29.153192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60df3d38-126b-4443-8bff-46085c0bd5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:29.182441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-60df3d38-126b-4443-8bff-46085c0bd5e8 None None] MFA Rules not processed for user `2dcf7b4fce0e40838b0cb9f3de19296c`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:29.183675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-60df3d38-126b-4443-8bff-46085c0bd5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:29.254539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1186/2381] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:29.265690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:29.267485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:29.313580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:29.352368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f1e3d7-1f17-40e0-85b6-8f61ab72912a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:29.356408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be2cb98356b4d628408d094589a83e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:29.356883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:29.357164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:29.357444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:29.367024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:29.368458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:29.377235 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1196/2382] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:34.405439 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968abd6-343c-40c5-97b3-89859023a837 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:34.405865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968abd6-343c-40c5-97b3-89859023a837 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:34.406191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968abd6-343c-40c5-97b3-89859023a837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:34.425558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3968abd6-343c-40c5-97b3-89859023a837 None None] MFA Rules not processed for user `db949ab99ca14a788b2815e3ba59440c`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:34.426789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3968abd6-343c-40c5-97b3-89859023a837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:34.482150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1187/2383] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:40:39.373396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=17 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:43.529301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:43.530680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:43.595424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fdab10-c81f-40d0-bb94-ad2e3b7b5da0 service glance] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:43.599098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d184f34-05fa-462a-95cb-8a6cd8121d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:43.599705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184f34-05fa-462a-95cb-8a6cd8121d2a service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:43.599990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184f34-05fa-462a-95cb-8a6cd8121d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:43.600267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d184f34-05fa-462a-95cb-8a6cd8121d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:43.602145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2d184f34-05fa-462a-95cb-8a6cd8121d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:43.668395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d184f34-05fa-462a-95cb-8a6cd8121d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:43.669906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d184f34-05fa-462a-95cb-8a6cd8121d2a service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:43.680262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1197/2384] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:43 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:44.475530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:53.675946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=50 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:56.531367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968abd6-343c-40c5-97b3-89859023a837 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:56.594444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968abd6-343c-40c5-97b3-89859023a837 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:56.598964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:56.599595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:56.599878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:56.600154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] PATH_INFO: `/v3/users/2dcf7b4fce0e40838b0cb9f3de19296c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:56.601278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcf7b4fce0e40838b0cb9f3de19296c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:56.603232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:56.648648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcf7b4fce0e40838b0cb9f3de19296c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:56.649307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcf7b4fce0e40838b0cb9f3de19296c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:56.657163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcf7b4fce0e40838b0cb9f3de19296c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:56.664751 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcf7b4fce0e40838b0cb9f3de19296c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:56.678408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcf7b4fce0e40838b0cb9f3de19296c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:56.684609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1188/2385] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:40:56 2022] DELETE /identity/v3/users/2dcf7b4fce0e40838b0cb9f3de19296c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:56.689784 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd605-c0ab-494f-a965-55eab24ad910 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:56.690320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd605-c0ab-494f-a965-55eab24ad910 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:56.690655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefcd605-c0ab-494f-a965-55eab24ad910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:56.711729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-aefcd605-c0ab-494f-a965-55eab24ad910 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:56.713002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aefcd605-c0ab-494f-a965-55eab24ad910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:56.771539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1198/2386] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:56.781290 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:56.783313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:56.840521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddb336-da86-4631-9c22-b56cc45f621d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:56.844669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816992d-241f-4705-8639-d498079d5af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:56.845468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816992d-241f-4705-8639-d498079d5af6 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:56.845752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816992d-241f-4705-8639-d498079d5af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:56.846064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816992d-241f-4705-8639-d498079d5af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:56.854969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816992d-241f-4705-8639-d498079d5af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:56.856426 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0816992d-241f-4705-8639-d498079d5af6 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:56.866786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1189/2387] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:57.134508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcd605-c0ab-494f-a965-55eab24ad910 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:57.136032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aefcd605-c0ab-494f-a965-55eab24ad910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:57.149002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefcd605-c0ab-494f-a965-55eab24ad910 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:57.153830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:57.154517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.154913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.155194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] PATH_INFO: `/v3/projects/5120688742094893bfe0fff350262ef5` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.157414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5120688742094893bfe0fff350262ef5)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:57.159836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:57.206556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5120688742094893bfe0fff350262ef5', 'request_id': 'req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:57.212565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5120688742094893bfe0fff350262ef5', 'request_id': 'req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:57.220191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5120688742094893bfe0fff350262ef5', 'request_id': 'req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:57.230558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] The token cache is being invalidate because project 5120688742094893bfe0fff350262ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:40:57.230849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:57.231469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-a641e4e0-8d4b-41f4-ac8c-5b4306c57d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:40:57.232932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1199/2388] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:40:57 2022] DELETE /identity/v3/projects/5120688742094893bfe0fff350262ef5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:57.237957 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d19d8-aef6-403f-853e-f4a0fbc5db08 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.238255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d19d8-aef6-403f-853e-f4a0fbc5db08 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.238536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25d19d8-aef6-403f-853e-f4a0fbc5db08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.257467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f25d19d8-aef6-403f-853e-f4a0fbc5db08 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:57.258628 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f25d19d8-aef6-403f-853e-f4a0fbc5db08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:57.276458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:57.320125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1190/2389] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:57.327976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858d9b-d09d-4dd6-bea0-d7bb46d21c6e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.328266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858d9b-d09d-4dd6-bea0-d7bb46d21c6e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.329066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18858d9b-d09d-4dd6-bea0-d7bb46d21c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.349491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-18858d9b-d09d-4dd6-bea0-d7bb46d21c6e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:57.350752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-18858d9b-d09d-4dd6-bea0-d7bb46d21c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:57.358587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1200/2390] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:57.363050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d19d8-aef6-403f-853e-f4a0fbc5db08 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:57.372573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25d19d8-aef6-403f-853e-f4a0fbc5db08 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:57.377199 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:57.377790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.378117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.378399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.379044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:40:57.379348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:57.380938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:57.393271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1191/2391] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:40:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:40:57.397525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18858d9b-d09d-4dd6-bea0-d7bb46d21c6e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:57.407393 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18858d9b-d09d-4dd6-bea0-d7bb46d21c6e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:57.412188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e64f-3e19-4f95-ad54-7839c249a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:57.412782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e64f-3e19-4f95-ad54-7839c249a845 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.413061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e64f-3e19-4f95-ad54-7839c249a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.413333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999e64f-3e19-4f95-ad54-7839c249a845 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.414009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999e64f-3e19-4f95-ad54-7839c249a845 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:57.416153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999e64f-3e19-4f95-ad54-7839c249a845 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:57.443483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1201/2392] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:40:57 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:57.447537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:57.458310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0249a-ada0-4976-bda2-b3a168afb3fd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:57.518543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fcc4f-813f-451b-9e42-9547b901eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:57.519104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fcc4f-813f-451b-9e42-9547b901eaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.519390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fcc4f-813f-451b-9e42-9547b901eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.519663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fcc4f-813f-451b-9e42-9547b901eaf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.520310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fcc4f-813f-451b-9e42-9547b901eaf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:57.522271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fcc4f-813f-451b-9e42-9547b901eaf2 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:57.543291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1192/2393] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:40:57 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:40:57.547552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e64f-3e19-4f95-ad54-7839c249a845 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:57.557808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999e64f-3e19-4f95-ad54-7839c249a845 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:57.562448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59767-e923-4297-8641-eba02b9e25f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:57.563729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59767-e923-4297-8641-eba02b9e25f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.564098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59767-e923-4297-8641-eba02b9e25f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.564374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b59767-e923-4297-8641-eba02b9e25f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.565027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b59767-e923-4297-8641-eba02b9e25f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:57.566651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b59767-e923-4297-8641-eba02b9e25f7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:57.577229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1202/2394] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:57.581705 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fcc4f-813f-451b-9e42-9547b901eaf2 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:57.591810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fcc4f-813f-451b-9e42-9547b901eaf2 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:57.596585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0bf93f-bf7b-43a8-a3f0-e28062851d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:57.597179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf93f-bf7b-43a8-a3f0-e28062851d24 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.597465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf93f-bf7b-43a8-a3f0-e28062851d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.597744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0bf93f-bf7b-43a8-a3f0-e28062851d24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.598421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bf93f-bf7b-43a8-a3f0-e28062851d24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:57.600038 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0bf93f-bf7b-43a8-a3f0-e28062851d24 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:57.610491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1193/2395] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:40:57.614424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59767-e923-4297-8641-eba02b9e25f7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:57.624241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b59767-e923-4297-8641-eba02b9e25f7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:57.629561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:57.630227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.630511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.630789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] PATH_INFO: `/v3/projects/bd471e2b862146c98c608914192fbcf4/users/967bad0ace354953965d4a0b10bc5b80/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.645838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd471e2b862146c98c608914192fbcf4, user_id=967bad0ace354953965d4a0b10bc5b80, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:57.648647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:57.661666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1203/2396] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:40:57 2022] PUT /identity/v3/projects/bd471e2b862146c98c608914192fbcf4/users/967bad0ace354953965d4a0b10bc5b80/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:40:57.672282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb28e-610c-4187-bc72-4d997d506533 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.672556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb28e-610c-4187-bc72-4d997d506533 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.672833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fb28e-610c-4187-bc72-4d997d506533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.700877 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-562fb28e-610c-4187-bc72-4d997d506533 None None] MFA Rules not processed for user `967bad0ace354953965d4a0b10bc5b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:57.702117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-562fb28e-610c-4187-bc72-4d997d506533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:57.764318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1194/2397] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:40:57.775520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:40:57.777195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:57.800593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:40:57.836587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ba840c-4d91-4af7-9e6a-e931b6558e89 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:40:57.840191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d079d99-c717-439e-9963-262fb919255e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:40:57.840786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079d99-c717-439e-9963-262fb919255e service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:57.841064 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079d99-c717-439e-9963-262fb919255e service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:57.841333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d079d99-c717-439e-9963-262fb919255e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:57.849703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d079d99-c717-439e-9963-262fb919255e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:40:57.851160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d079d99-c717-439e-9963-262fb919255e service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:40:57.860311 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1204/2398] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:40:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:40:59.206441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971031-3b47-439b-b439-d79d2540735d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:40:59.206963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971031-3b47-439b-b439-d79d2540735d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:40:59.207060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a971031-3b47-439b-b439-d79d2540735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:40:59.227415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-2a971031-3b47-439b-b439-d79d2540735d None None] MFA Rules not processed for user `967bad0ace354953965d4a0b10bc5b80`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:40:59.228634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2a971031-3b47-439b-b439-d79d2540735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:40:59.235482 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1195/2399] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:40:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:07.855878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=17 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:09.220933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:17.919636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be56651-1939-4f28-9982-9e7e34801f12 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:17.920111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be56651-1939-4f28-9982-9e7e34801f12 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:17.920204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be56651-1939-4f28-9982-9e7e34801f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:17.939628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5be56651-1939-4f28-9982-9e7e34801f12 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:17.940818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5be56651-1939-4f28-9982-9e7e34801f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:17.994283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1205/2400] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:41:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:18.042120 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971031-3b47-439b-b439-d79d2540735d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:18.043635 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2a971031-3b47-439b-b439-d79d2540735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:18.111576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a971031-3b47-439b-b439-d79d2540735d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:18.116505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66e3c-2ac8-44ba-a5f9-dce7c06a555e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:18.117110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66e3c-2ac8-44ba-a5f9-dce7c06a555e service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:18.117395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66e3c-2ac8-44ba-a5f9-dce7c06a555e service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:18.117671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd66e3c-2ac8-44ba-a5f9-dce7c06a555e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:18.125598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd66e3c-2ac8-44ba-a5f9-dce7c06a555e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:18.127400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd66e3c-2ac8-44ba-a5f9-dce7c06a555e service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:18.135328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1196/2401] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:41:18.698820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab76bd-c846-4e78-8a50-1b2270000593 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:18.699111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab76bd-c846-4e78-8a50-1b2270000593 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:18.699388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab76bd-c846-4e78-8a50-1b2270000593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:18.717690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-58ab76bd-c846-4e78-8a50-1b2270000593 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:18.718904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-58ab76bd-c846-4e78-8a50-1b2270000593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:18.726348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1206/2402] 10.222.0.88 () {58 vars in 967 bytes} [Fri Aug 26 00:41:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:18.739633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66e3c-2ac8-44ba-a5f9-dce7c06a555e service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:18.750294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd66e3c-2ac8-44ba-a5f9-dce7c06a555e service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:18.755818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e719e-24a6-4aa0-ac81-62c28f3f8583 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:18.756417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e719e-24a6-4aa0-ac81-62c28f3f8583 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:18.756704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e719e-24a6-4aa0-ac81-62c28f3f8583 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:18.756981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e719e-24a6-4aa0-ac81-62c28f3f8583 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:18.765059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e719e-24a6-4aa0-ac81-62c28f3f8583 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:18.767406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e719e-24a6-4aa0-ac81-62c28f3f8583 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:18.775542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1197/2403] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:41:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:41:19.005168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e5d0a-f525-4873-a841-1056ef1bc7ed None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:19.005628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e5d0a-f525-4873-a841-1056ef1bc7ed None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:19.005748 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e5d0a-f525-4873-a841-1056ef1bc7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:19.024740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9e8e5d0a-f525-4873-a841-1056ef1bc7ed None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:19.025937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9e8e5d0a-f525-4873-a841-1056ef1bc7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:19.033575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1207/2404] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:41:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:19.045385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e719e-24a6-4aa0-ac81-62c28f3f8583 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:19.055801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e719e-24a6-4aa0-ac81-62c28f3f8583 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:19.060693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa22e8-58c2-46cd-a8e2-f0bbec532280 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:19.061278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa22e8-58c2-46cd-a8e2-f0bbec532280 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:19.061557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa22e8-58c2-46cd-a8e2-f0bbec532280 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:19.061829 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa22e8-58c2-46cd-a8e2-f0bbec532280 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:19.069696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa22e8-58c2-46cd-a8e2-f0bbec532280 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:19.071304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fa22e8-58c2-46cd-a8e2-f0bbec532280 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:19.079783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1198/2405] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:41:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 00:41:19.397288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c43e1b-ff08-40c2-8584-42319d5a6ab5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:19.397580 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c43e1b-ff08-40c2-8584-42319d5a6ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:19.397861 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c43e1b-ff08-40c2-8584-42319d5a6ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:19.419631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-b8c43e1b-ff08-40c2-8584-42319d5a6ab5 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:19.420850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b8c43e1b-ff08-40c2-8584-42319d5a6ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:19.428696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1208/2406] 10.222.0.88 () {58 vars in 967 bytes} [Fri Aug 26 00:41:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:41:19.441465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa22e8-58c2-46cd-a8e2-f0bbec532280 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:19.452289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa22e8-58c2-46cd-a8e2-f0bbec532280 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:19.458049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00141022-ce6b-4e7c-942c-11a099923cf9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:19.458748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141022-ce6b-4e7c-942c-11a099923cf9 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:19.459053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141022-ce6b-4e7c-942c-11a099923cf9 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:19.459311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00141022-ce6b-4e7c-942c-11a099923cf9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:19.467333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141022-ce6b-4e7c-942c-11a099923cf9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:19.468959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00141022-ce6b-4e7c-942c-11a099923cf9 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:19.477194 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1199/2407] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:41:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:41:21.718000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c43e1b-ff08-40c2-8584-42319d5a6ab5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:21.780556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c43e1b-ff08-40c2-8584-42319d5a6ab5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:21.785067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:21.785693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:21.786018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:21.786297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] PATH_INFO: `/v3/users/967bad0ace354953965d4a0b10bc5b80` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:21.787415 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967bad0ace354953965d4a0b10bc5b80)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:21.789350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:21.835910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967bad0ace354953965d4a0b10bc5b80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:21.847700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967bad0ace354953965d4a0b10bc5b80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:21.848359 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967bad0ace354953965d4a0b10bc5b80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:21.855406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967bad0ace354953965d4a0b10bc5b80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:21.862968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967bad0ace354953965d4a0b10bc5b80'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:21.868958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1209/2408] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:41:21 2022] DELETE /identity/v3/users/967bad0ace354953965d4a0b10bc5b80 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:41:21.873385 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2f6d-d024-441b-8d18-aa4b21515c00 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:21.873867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2f6d-d024-441b-8d18-aa4b21515c00 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:21.874138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd2f6d-d024-441b-8d18-aa4b21515c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:21.893631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d0fd2f6d-d024-441b-8d18-aa4b21515c00 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:21.895072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d0fd2f6d-d024-441b-8d18-aa4b21515c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:21.955585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1200/2409] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:41:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:21.967471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:21.968768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:21.976062 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:22.031399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba8279-ffa3-4b55-888a-6afd30084bb6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.035113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5146af-85bc-421b-a5a1-1daa54b43cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.035726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5146af-85bc-421b-a5a1-1daa54b43cbe service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.036010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5146af-85bc-421b-a5a1-1daa54b43cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.036286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5146af-85bc-421b-a5a1-1daa54b43cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.045791 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5146af-85bc-421b-a5a1-1daa54b43cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.047260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5146af-85bc-421b-a5a1-1daa54b43cbe service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.057434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1210/2410] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:41:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:41:22.262651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd2f6d-d024-441b-8d18-aa4b21515c00 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:22.264199 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d0fd2f6d-d024-441b-8d18-aa4b21515c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:22.278324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd2f6d-d024-441b-8d18-aa4b21515c00 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.283831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.284471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.284750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.285023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] PATH_INFO: `/v3/projects/bd471e2b862146c98c608914192fbcf4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.286181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd471e2b862146c98c608914192fbcf4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.288096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.333579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:22.336764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd471e2b862146c98c608914192fbcf4', 'request_id': 'req-8f37fe17-7c08-4bed-b774-7e20993f49d9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:22.342527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd471e2b862146c98c608914192fbcf4', 'request_id': 'req-8f37fe17-7c08-4bed-b774-7e20993f49d9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:22.350744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd471e2b862146c98c608914192fbcf4', 'request_id': 'req-8f37fe17-7c08-4bed-b774-7e20993f49d9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:22.362379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] The token cache is being invalidate because project bd471e2b862146c98c608914192fbcf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:41:22.362665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:22.363316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-8f37fe17-7c08-4bed-b774-7e20993f49d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:41:22.364780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1201/2411] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:41:22 2022] DELETE /identity/v3/projects/bd471e2b862146c98c608914192fbcf4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:41:22.369745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44d88-384e-4481-b3b9-579fdde46487 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.370075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44d88-384e-4481-b3b9-579fdde46487 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.370354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d44d88-384e-4481-b3b9-579fdde46487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.389808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-63d44d88-384e-4481-b3b9-579fdde46487 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:22.391045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-63d44d88-384e-4481-b3b9-579fdde46487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:22.450550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1211/2412] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:22.458463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22e2f3-f347-4242-83a9-04ade7181246 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.458696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22e2f3-f347-4242-83a9-04ade7181246 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.458981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e22e2f3-f347-4242-83a9-04ade7181246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.484292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7e22e2f3-f347-4242-83a9-04ade7181246 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:22.486189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7e22e2f3-f347-4242-83a9-04ade7181246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:22.494075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1202/2413] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:22.498277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d44d88-384e-4481-b3b9-579fdde46487 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:22.508095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d44d88-384e-4481-b3b9-579fdde46487 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.512599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.513186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.513464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.513737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.514418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:41:22.514717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.516824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.527992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1212/2414] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:41:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:41:22.532716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22e2f3-f347-4242-83a9-04ade7181246 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:22.542360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e22e2f3-f347-4242-83a9-04ade7181246 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.547077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a7e1-0145-4d2c-8041-11071ebebf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.547782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a7e1-0145-4d2c-8041-11071ebebf2a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.548091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a7e1-0145-4d2c-8041-11071ebebf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.548441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a7e1-0145-4d2c-8041-11071ebebf2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.549074 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783a7e1-0145-4d2c-8041-11071ebebf2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.551030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783a7e1-0145-4d2c-8041-11071ebebf2a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.579523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1203/2415] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:41:22 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:41:22.583965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:22.594014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26fbe7c-4582-4988-843d-30d510845d83 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.650245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d708448-1021-46af-ad31-892440e6945c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.650842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708448-1021-46af-ad31-892440e6945c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.651131 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708448-1021-46af-ad31-892440e6945c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.651403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d708448-1021-46af-ad31-892440e6945c admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.652053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d708448-1021-46af-ad31-892440e6945c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.653990 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d708448-1021-46af-ad31-892440e6945c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.675697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1213/2416] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:41:22 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:41:22.679776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a7e1-0145-4d2c-8041-11071ebebf2a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:22.690754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a7e1-0145-4d2c-8041-11071ebebf2a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.695909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6329b38-247a-4d2b-b931-b8293209047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.696510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6329b38-247a-4d2b-b931-b8293209047b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.696828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6329b38-247a-4d2b-b931-b8293209047b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.697131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6329b38-247a-4d2b-b931-b8293209047b admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.697777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6329b38-247a-4d2b-b931-b8293209047b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.699435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6329b38-247a-4d2b-b931-b8293209047b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.709949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1204/2417] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:41:22.713741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d708448-1021-46af-ad31-892440e6945c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:22.724686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d708448-1021-46af-ad31-892440e6945c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.729344 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f719bc9-0e20-47b4-bd8f-b50fe1bb4797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.729970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719bc9-0e20-47b4-bd8f-b50fe1bb4797 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.730261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719bc9-0e20-47b4-bd8f-b50fe1bb4797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.730542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f719bc9-0e20-47b4-bd8f-b50fe1bb4797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.731249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f719bc9-0e20-47b4-bd8f-b50fe1bb4797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.732846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f719bc9-0e20-47b4-bd8f-b50fe1bb4797 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.743741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1214/2418] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:41:22.747777 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6329b38-247a-4d2b-b931-b8293209047b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:22.758188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6329b38-247a-4d2b-b931-b8293209047b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.762843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.763528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.763817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.764098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] PATH_INFO: `/v3/projects/201a57e9255e4838b6798e970a95d63b/users/5f5d594ff9d1454db2c5f4f59cb64e5c/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.779302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=201a57e9255e4838b6798e970a95d63b, user_id=5f5d594ff9d1454db2c5f4f59cb64e5c, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.782514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.796321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1205/2419] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:41:22 2022] PUT /identity/v3/projects/201a57e9255e4838b6798e970a95d63b/users/5f5d594ff9d1454db2c5f4f59cb64e5c/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:41:22.801405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd26033-f846-4b2e-b4dd-a3f1d8bb251a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.801692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd26033-f846-4b2e-b4dd-a3f1d8bb251a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.801999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd26033-f846-4b2e-b4dd-a3f1d8bb251a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.820822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-2bd26033-f846-4b2e-b4dd-a3f1d8bb251a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:22.822081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2bd26033-f846-4b2e-b4dd-a3f1d8bb251a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:22.831063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:22.883168 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1215/2420] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:41:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:22.893608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:22.895563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:22.956501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27f09ca-724c-4cf0-ba77-7b901a9b2697 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:22.960211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4cc34-1b8f-407c-b808-59c68349ae63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:22.960762 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4cc34-1b8f-407c-b808-59c68349ae63 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:22.961047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4cc34-1b8f-407c-b808-59c68349ae63 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:22.961325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4cc34-1b8f-407c-b808-59c68349ae63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:22.970747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4cc34-1b8f-407c-b808-59c68349ae63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:22.972234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4cc34-1b8f-407c-b808-59c68349ae63 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:22.982472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1206/2421] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:41:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:41:27.204657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24b4b-2a92-44b0-9085-3e1983ed2d2a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:27.205171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24b4b-2a92-44b0-9085-3e1983ed2d2a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:27.205276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f24b4b-2a92-44b0-9085-3e1983ed2d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:27.234054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f0f24b4b-2a92-44b0-9085-3e1983ed2d2a None None] MFA Rules not processed for user `5f5d594ff9d1454db2c5f4f59cb64e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:27.235320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f0f24b4b-2a92-44b0-9085-3e1983ed2d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:27.330259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1216/2422] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:41:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:27.334618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4cc34-1b8f-407c-b808-59c68349ae63 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:27.345781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4cc34-1b8f-407c-b808-59c68349ae63 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:27.354437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2273a4-699b-4ea2-aa6e-d944293b6849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:27.355149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2273a4-699b-4ea2-aa6e-d944293b6849 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:27.355656 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2273a4-699b-4ea2-aa6e-d944293b6849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:27.356126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2273a4-699b-4ea2-aa6e-d944293b6849 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:27.357011 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2273a4-699b-4ea2-aa6e-d944293b6849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:27.359160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2273a4-699b-4ea2-aa6e-d944293b6849 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:27.390869 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1207/2423] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:41:27 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:41:27.395828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f24b4b-2a92-44b0-9085-3e1983ed2d2a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:27.408012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f24b4b-2a92-44b0-9085-3e1983ed2d2a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:27.474366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc77561-8ce8-4df1-b23c-b62624577225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:27.475085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc77561-8ce8-4df1-b23c-b62624577225 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:27.475432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc77561-8ce8-4df1-b23c-b62624577225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:27.475777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc77561-8ce8-4df1-b23c-b62624577225 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:27.476488 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc77561-8ce8-4df1-b23c-b62624577225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:27.478582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc77561-8ce8-4df1-b23c-b62624577225 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:27.501335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1217/2424] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:41:27 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:41:27.505425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2273a4-699b-4ea2-aa6e-d944293b6849 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:27.517394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2273a4-699b-4ea2-aa6e-d944293b6849 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:27.522371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc296b-3242-49d6-9c41-4cf7fb817bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:27.522980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc296b-3242-49d6-9c41-4cf7fb817bdc admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:27.523261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc296b-3242-49d6-9c41-4cf7fb817bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:27.523538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc296b-3242-49d6-9c41-4cf7fb817bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:27.524188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc296b-3242-49d6-9c41-4cf7fb817bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:27.525999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc296b-3242-49d6-9c41-4cf7fb817bdc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:27.537660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1208/2425] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:41:27.542223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc77561-8ce8-4df1-b23c-b62624577225 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:27.552963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc77561-8ce8-4df1-b23c-b62624577225 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:27.561430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da060ab-d806-41ea-9040-0dacd09b269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:27.562188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da060ab-d806-41ea-9040-0dacd09b269a admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:27.562598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da060ab-d806-41ea-9040-0dacd09b269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:27.563469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da060ab-d806-41ea-9040-0dacd09b269a admin admin] PATH_INFO: `/v3/projects/eaa43da462724d30abccfc0d5b121b98/users/dd9f6c1b2a43430e9d0315fcb448c49d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:27.581086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da060ab-d806-41ea-9040-0dacd09b269a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa43da462724d30abccfc0d5b121b98, user_id=dd9f6c1b2a43430e9d0315fcb448c49d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:27.583814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da060ab-d806-41ea-9040-0dacd09b269a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:27.598632 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1218/2426] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:41:27 2022] PUT /identity/v3/projects/eaa43da462724d30abccfc0d5b121b98/users/dd9f6c1b2a43430e9d0315fcb448c49d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:41:27.602827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc296b-3242-49d6-9c41-4cf7fb817bdc admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:27.613345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc296b-3242-49d6-9c41-4cf7fb817bdc admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:27.655052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:27.676330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf68a3-0f36-40d8-a03b-1d26d7e30aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:27.676947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf68a3-0f36-40d8-a03b-1d26d7e30aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:27.677230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf68a3-0f36-40d8-a03b-1d26d7e30aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:27.677499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf68a3-0f36-40d8-a03b-1d26d7e30aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:27.678213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf68a3-0f36-40d8-a03b-1d26d7e30aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:27.679827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf68a3-0f36-40d8-a03b-1d26d7e30aa6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:27.693698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1209/2427] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:41:27 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:41:27.695946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da060ab-d806-41ea-9040-0dacd09b269a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:27.707801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da060ab-d806-41ea-9040-0dacd09b269a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:27.712528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:27.713234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:27.713505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:27.713699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] PATH_INFO: `/v3/projects/eaa43da462724d30abccfc0d5b121b98/users/dd9f6c1b2a43430e9d0315fcb448c49d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:27.715892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa43da462724d30abccfc0d5b121b98, user_id=dd9f6c1b2a43430e9d0315fcb448c49d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:27.718556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:27.722142 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:27.731264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1219/2428] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:41:27 2022] PUT /identity/v3/projects/eaa43da462724d30abccfc0d5b121b98/users/dd9f6c1b2a43430e9d0315fcb448c49d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:41:35.511987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7f05b-fef5-485e-8f71-cea9d2e424a5 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:35.512590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7f05b-fef5-485e-8f71-cea9d2e424a5 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:35.512807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a7f05b-fef5-485e-8f71-cea9d2e424a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:35.546253 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-52a7f05b-fef5-485e-8f71-cea9d2e424a5 None None] MFA Rules not processed for user `dd9f6c1b2a43430e9d0315fcb448c49d`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:35.548685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-52a7f05b-fef5-485e-8f71-cea9d2e424a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:35.654392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1210/2429] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:41:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:35.668444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:35.671364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:35.748942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2826a2-e332-404b-9b9b-6e92772beb12 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:35.755615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be2cb98356b4d628408d094589a83e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:35.756700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:35.757146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:35.757594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:35.835887 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:35.838674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:35.860717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1220/2430] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:41:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:41:36.035675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76079c0-be63-4556-9f45-c9a6bd375d77 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:36.036201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76079c0-be63-4556-9f45-c9a6bd375d77 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:36.036633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76079c0-be63-4556-9f45-c9a6bd375d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:36.061910 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f76079c0-be63-4556-9f45-c9a6bd375d77 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:36.064396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f76079c0-be63-4556-9f45-c9a6bd375d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:36.151880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1211/2431] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:41:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:36.167143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:36.168898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:36.263243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac926991-2c4b-419c-b09b-6f50c579b378 service glance] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:36.268694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f02c8-599c-472e-bc50-4153c14d626c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:36.269319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f02c8-599c-472e-bc50-4153c14d626c service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:36.269595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f02c8-599c-472e-bc50-4153c14d626c service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:36.270295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f02c8-599c-472e-bc50-4153c14d626c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:36.279778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f02c8-599c-472e-bc50-4153c14d626c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:36.281414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f02c8-599c-472e-bc50-4153c14d626c service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:36.295958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1221/2432] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:41:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:41:41.494478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76079c0-be63-4556-9f45-c9a6bd375d77 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:41.496116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f76079c0-be63-4556-9f45-c9a6bd375d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:41.603281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76079c0-be63-4556-9f45-c9a6bd375d77 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:41.613157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d57f5a-a28a-4e82-b93e-5bff071d1144 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:41.613653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57f5a-a28a-4e82-b93e-5bff071d1144 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:41.614219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57f5a-a28a-4e82-b93e-5bff071d1144 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:41.614599 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d57f5a-a28a-4e82-b93e-5bff071d1144 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:41.616958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-63d57f5a-a28a-4e82-b93e-5bff071d1144 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:41.632224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:41.635788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57f5a-a28a-4e82-b93e-5bff071d1144 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:41.637769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d57f5a-a28a-4e82-b93e-5bff071d1144 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:41.655787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1212/2433] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:41:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:41:45.576331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4188d-8ab5-432c-a234-edf075853fde None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:45.576869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4188d-8ab5-432c-a234-edf075853fde None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:45.577527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4188d-8ab5-432c-a234-edf075853fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:45.601571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-51e4188d-8ab5-432c-a234-edf075853fde None None] MFA Rules not processed for user `266a34590c4645ffa4c1c4afe3a9970d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:45.603148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-51e4188d-8ab5-432c-a234-edf075853fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:45.643824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:45.673032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1222/2434] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:41:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:46.086632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369da20a-08b8-4483-8bd4-588950648d59 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:46.087230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369da20a-08b8-4483-8bd4-588950648d59 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:46.087337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369da20a-08b8-4483-8bd4-588950648d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:46.107422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-369da20a-08b8-4483-8bd4-588950648d59 None None] MFA Rules not processed for user `5f5d594ff9d1454db2c5f4f59cb64e5c`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:46.108804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-369da20a-08b8-4483-8bd4-588950648d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:46.117023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1213/2435] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:41:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:49.224316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64adf-8b64-443e-b6d8-528f7a30e54d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:49.224963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64adf-8b64-443e-b6d8-528f7a30e54d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:49.225102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d64adf-8b64-443e-b6d8-528f7a30e54d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:49.244706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-90d64adf-8b64-443e-b6d8-528f7a30e54d None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:41:49.246079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-90d64adf-8b64-443e-b6d8-528f7a30e54d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:41:49.254221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1223/2436] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:41:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:41:49.266996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369da20a-08b8-4483-8bd4-588950648d59 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:41:49.278593 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369da20a-08b8-4483-8bd4-588950648d59 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:41:49.284563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2495e-1a10-4634-93df-726db167f1e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:41:49.285231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2495e-1a10-4634-93df-726db167f1e5 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:41:49.285576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2495e-1a10-4634-93df-726db167f1e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:41:49.286117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e2495e-1a10-4634-93df-726db167f1e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:41:49.295233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2495e-1a10-4634-93df-726db167f1e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:41:49.296974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e2495e-1a10-4634-93df-726db167f1e5 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:41:49.305642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1214/2437] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:41:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 00:41:59.239821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=10 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:41:59.302752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=11 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:13.139352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0dd3d-8543-4e10-a241-8969c5fa9fa2 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:13.139859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0dd3d-8543-4e10-a241-8969c5fa9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:13.139957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee0dd3d-8543-4e10-a241-8969c5fa9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:13.159548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3ee0dd3d-8543-4e10-a241-8969c5fa9fa2 None None] MFA Rules not processed for user `db949ab99ca14a788b2815e3ba59440c`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:42:13.160788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ee0dd3d-8543-4e10-a241-8969c5fa9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:42:13.216783 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1224/2438] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:42:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:42:20.070978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2495e-1a10-4634-93df-726db167f1e5 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:42:20.124354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e2495e-1a10-4634-93df-726db167f1e5 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:42:20.128648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac087dd-25bb-427b-8aaf-f48c62b32c75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:42:20.129244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac087dd-25bb-427b-8aaf-f48c62b32c75 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:42:20.129530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac087dd-25bb-427b-8aaf-f48c62b32c75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:42:20.129806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac087dd-25bb-427b-8aaf-f48c62b32c75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:42:20.138687 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac087dd-25bb-427b-8aaf-f48c62b32c75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:42:20.140172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac087dd-25bb-427b-8aaf-f48c62b32c75 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:42:20.149487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1215/2439] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:42:20 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:42:23.210328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=25 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:42:30.145458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=26 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:12.925397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25390b1-767a-435d-a013-5acc976db610 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:12.925961 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25390b1-767a-435d-a013-5acc976db610 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:12.926171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25390b1-767a-435d-a013-5acc976db610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:12.945682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c25390b1-767a-435d-a013-5acc976db610 None None] MFA Rules not processed for user `266a34590c4645ffa4c1c4afe3a9970d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:12.946943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c25390b1-767a-435d-a013-5acc976db610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:12.955734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1225/2440] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:43:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:43:17.792920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a208a-c886-4b63-ae66-6557463de91b None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:17.793456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a208a-c886-4b63-ae66-6557463de91b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:17.793456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a208a-c886-4b63-ae66-6557463de91b None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:17.795112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1216/2441] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 26 00:43:17.801888 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f130a-21c6-4e8f-b0fa-55fb16c67b88 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:17.802411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f130a-21c6-4e8f-b0fa-55fb16c67b88 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:17.802778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f130a-21c6-4e8f-b0fa-55fb16c67b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:17.824081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4a3f130a-21c6-4e8f-b0fa-55fb16c67b88 None None] MFA Rules not processed for user `a0e9262597de4799a64977e44b41e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:17.825387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a3f130a-21c6-4e8f-b0fa-55fb16c67b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:17.832905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1226/2442] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:43:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:43:17.845818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a208a-c886-4b63-ae66-6557463de91b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:17.857734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a208a-c886-4b63-ae66-6557463de91b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:17.862563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc168c3-d09d-4d97-87bb-9a5e29cd1db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:17.863175 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc168c3-d09d-4d97-87bb-9a5e29cd1db4 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:17.863463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc168c3-d09d-4d97-87bb-9a5e29cd1db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:17.863768 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc168c3-d09d-4d97-87bb-9a5e29cd1db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:17.872279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc168c3-d09d-4d97-87bb-9a5e29cd1db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:17.873731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc168c3-d09d-4d97-87bb-9a5e29cd1db4 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:17.882928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1217/2443] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:43:17.975301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370b1a-3e51-4c47-bba2-0f1745eae2b3 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:17.975769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370b1a-3e51-4c47-bba2-0f1745eae2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:17.976052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11370b1a-3e51-4c47-bba2-0f1745eae2b3 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:17.977441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1227/2444] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:43:17.986595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3d6d-5177-43fa-aa47-9f3786dba555 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:17.987094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3d6d-5177-43fa-aa47-9f3786dba555 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:17.987373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c3d6d-5177-43fa-aa47-9f3786dba555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:18.008805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-605c3d6d-5177-43fa-aa47-9f3786dba555 None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:18.010077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-605c3d6d-5177-43fa-aa47-9f3786dba555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:18.088612 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1218/2445] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:43:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:43:18.097076 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370b1a-3e51-4c47-bba2-0f1745eae2b3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:18.114584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11370b1a-3e51-4c47-bba2-0f1745eae2b3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:18.122944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b8ab1-9a1f-403b-b40b-74096b108139 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:18.127332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b8ab1-9a1f-403b-b40b-74096b108139 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:18.128717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b8ab1-9a1f-403b-b40b-74096b108139 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:18.130159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855b8ab1-9a1f-403b-b40b-74096b108139 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:18.146625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b8ab1-9a1f-403b-b40b-74096b108139 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:18.148943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855b8ab1-9a1f-403b-b40b-74096b108139 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:18.163716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1228/2446] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:43:27.673674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c3d6d-5177-43fa-aa47-9f3786dba555 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:27.675191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-605c3d6d-5177-43fa-aa47-9f3786dba555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:27.688045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c3d6d-5177-43fa-aa47-9f3786dba555 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:27.691714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1590deb-40f9-45b6-8386-9316462e8611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:27.692337 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1590deb-40f9-45b6-8386-9316462e8611 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:27.692618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1590deb-40f9-45b6-8386-9316462e8611 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:27.692888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1590deb-40f9-45b6-8386-9316462e8611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:27.694665 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f1590deb-40f9-45b6-8386-9316462e8611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:27.709255 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1590deb-40f9-45b6-8386-9316462e8611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:27.710752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1590deb-40f9-45b6-8386-9316462e8611 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:27.722611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1219/2447] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:43:28.039754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b8ab1-9a1f-403b-b40b-74096b108139 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:28.048663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855b8ab1-9a1f-403b-b40b-74096b108139 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:28.052240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681fbd0c-178c-4483-b0c0-f55cbddfa9a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:28.052821 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fbd0c-178c-4483-b0c0-f55cbddfa9a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:28.053096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fbd0c-178c-4483-b0c0-f55cbddfa9a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:28.053362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681fbd0c-178c-4483-b0c0-f55cbddfa9a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:28.055079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-681fbd0c-178c-4483-b0c0-f55cbddfa9a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:28.119888 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fbd0c-178c-4483-b0c0-f55cbddfa9a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:28.121335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681fbd0c-178c-4483-b0c0-f55cbddfa9a8 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:28.131612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1229/2448] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:43:29.915742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2541-3e7b-42b7-b728-655a1d8a3fa9 None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:29.916294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2541-3e7b-42b7-b728-655a1d8a3fa9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:29.916456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f2541-3e7b-42b7-b728-655a1d8a3fa9 None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:29.918113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1220/2449] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:43:29.948808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a760-c785-40fa-803a-9cf7da278049 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:29.949295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a760-c785-40fa-803a-9cf7da278049 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:29.949399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307a760-c785-40fa-803a-9cf7da278049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:29.973723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0307a760-c785-40fa-803a-9cf7da278049 None None] MFA Rules not processed for user `07c06e04bd894c57a035e01e92610a98`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:29.975421 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0307a760-c785-40fa-803a-9cf7da278049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:29.988591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1230/2450] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:43:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:43:29.989762 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f2541-3e7b-42b7-b728-655a1d8a3fa9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:29.991611 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ad3f2541-3e7b-42b7-b728-655a1d8a3fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:30.003755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307a760-c785-40fa-803a-9cf7da278049 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.005194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0307a760-c785-40fa-803a-9cf7da278049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:30.016125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f2541-3e7b-42b7-b728-655a1d8a3fa9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.019527 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307a760-c785-40fa-803a-9cf7da278049 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.021444 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.022101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.022578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.022863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] PATH_INFO: `/v3/users/db949ab99ca14a788b2815e3ba59440c` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.024014 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=db949ab99ca14a788b2815e3ba59440c)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.024878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6b7aa-5214-45f0-a427-7ac88ce05c4b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.025485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b7aa-5214-45f0-a427-7ac88ce05c4b service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.025768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b7aa-5214-45f0-a427-7ac88ce05c4b service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.026024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.026187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6b7aa-5214-45f0-a427-7ac88ce05c4b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.039407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6b7aa-5214-45f0-a427-7ac88ce05c4b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.040957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6b7aa-5214-45f0-a427-7ac88ce05c4b service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.052121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1231/2451] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:43:30.082581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db949ab99ca14a788b2815e3ba59440c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.083257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db949ab99ca14a788b2815e3ba59440c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.091058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db949ab99ca14a788b2815e3ba59440c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.101154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db949ab99ca14a788b2815e3ba59440c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.114224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db949ab99ca14a788b2815e3ba59440c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.122173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1221/2452] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:43:29 2022] DELETE /identity/v3/users/db949ab99ca14a788b2815e3ba59440c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:43:30.173299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6b7aa-5214-45f0-a427-7ac88ce05c4b service placement] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.182772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6b7aa-5214-45f0-a427-7ac88ce05c4b service placement] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.235377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51968620-7876-49dc-b74f-98411d242b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.235988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968620-7876-49dc-b74f-98411d242b58 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.236272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968620-7876-49dc-b74f-98411d242b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.236548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51968620-7876-49dc-b74f-98411d242b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.238411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-51968620-7876-49dc-b74f-98411d242b58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:30.312363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.313898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:30.323252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:30.344492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51968620-7876-49dc-b74f-98411d242b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.346182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51968620-7876-49dc-b74f-98411d242b58 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.358104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1232/2453] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:43:30.372294 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:30.398878 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e683a-055e-430e-9572-435cea0f48eb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.403568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.404284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.404606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.405391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] PATH_INFO: `/v3/projects/929e35361952471c9e177f5d991f25d8` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.406573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] RBAC: Authorizing `identity:delete_project(project_id=929e35361952471c9e177f5d991f25d8)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.408514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.469412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '929e35361952471c9e177f5d991f25d8', 'request_id': 'req-5a520f2f-cb6f-40b7-8952-a35ab69e462c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.482073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '929e35361952471c9e177f5d991f25d8', 'request_id': 'req-5a520f2f-cb6f-40b7-8952-a35ab69e462c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.498598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '929e35361952471c9e177f5d991f25d8', 'request_id': 'req-5a520f2f-cb6f-40b7-8952-a35ab69e462c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.510577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] The token cache is being invalidate because project 929e35361952471c9e177f5d991f25d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:43:30.510872 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.511550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5a520f2f-cb6f-40b7-8952-a35ab69e462c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:43:30.516983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1222/2454] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:43:30 2022] DELETE /identity/v3/projects/929e35361952471c9e177f5d991f25d8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:43:30.518825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322208a2-98d8-4b33-b047-043cd455d368 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.519141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322208a2-98d8-4b33-b047-043cd455d368 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.519418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322208a2-98d8-4b33-b047-043cd455d368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.540152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-322208a2-98d8-4b33-b047-043cd455d368 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:30.541372 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-322208a2-98d8-4b33-b047-043cd455d368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:30.604910 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1233/2455] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:43:30.612478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eafda0-3d92-4b54-b5f7-be8c89237e29 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.612849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eafda0-3d92-4b54-b5f7-be8c89237e29 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.613195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eafda0-3d92-4b54-b5f7-be8c89237e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.632894 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-99eafda0-3d92-4b54-b5f7-be8c89237e29 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:30.634151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-99eafda0-3d92-4b54-b5f7-be8c89237e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:30.643114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1223/2456] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:43:30.647467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322208a2-98d8-4b33-b047-043cd455d368 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.658680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322208a2-98d8-4b33-b047-043cd455d368 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.663654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.664259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.664538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.664808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.665458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:43:30.665761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.667405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.679517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1234/2457] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:43:30.683947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eafda0-3d92-4b54-b5f7-be8c89237e29 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.694028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eafda0-3d92-4b54-b5f7-be8c89237e29 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.698729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747ac6-8f7e-47ef-b97c-f68e4e5cce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.699324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747ac6-8f7e-47ef-b97c-f68e4e5cce68 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.699606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747ac6-8f7e-47ef-b97c-f68e4e5cce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.699880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68747ac6-8f7e-47ef-b97c-f68e4e5cce68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.700535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68747ac6-8f7e-47ef-b97c-f68e4e5cce68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.703300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68747ac6-8f7e-47ef-b97c-f68e4e5cce68 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.731958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1224/2458] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:43:30 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:43:30.736334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.746336 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4169a70-8688-4249-aeb8-e8143c3f6046 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.809301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbcd3f-bc46-4207-9f6c-0d796e1154dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.810114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbcd3f-bc46-4207-9f6c-0d796e1154dd admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.810454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbcd3f-bc46-4207-9f6c-0d796e1154dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.810735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbcd3f-bc46-4207-9f6c-0d796e1154dd admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.813686 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbcd3f-bc46-4207-9f6c-0d796e1154dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.815228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbcd3f-bc46-4207-9f6c-0d796e1154dd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.839002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1235/2459] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:43:30 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:43:30.843379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747ac6-8f7e-47ef-b97c-f68e4e5cce68 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.855077 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68747ac6-8f7e-47ef-b97c-f68e4e5cce68 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.859971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fc323-2536-4088-9531-058d9bf03c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.860577 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fc323-2536-4088-9531-058d9bf03c93 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.860858 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fc323-2536-4088-9531-058d9bf03c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.861131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928fc323-2536-4088-9531-058d9bf03c93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.861776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fc323-2536-4088-9531-058d9bf03c93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.863456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928fc323-2536-4088-9531-058d9bf03c93 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.874608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1225/2460] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:43:30.878609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbcd3f-bc46-4207-9f6c-0d796e1154dd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.889709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbcd3f-bc46-4207-9f6c-0d796e1154dd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.894920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a52c7-d253-47e8-b0d0-7c61f1600c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.895537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a52c7-d253-47e8-b0d0-7c61f1600c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.896752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a52c7-d253-47e8-b0d0-7c61f1600c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.896752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a52c7-d253-47e8-b0d0-7c61f1600c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.896752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a52c7-d253-47e8-b0d0-7c61f1600c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.898379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a52c7-d253-47e8-b0d0-7c61f1600c1c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.910977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1236/2461] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:43:30.918164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fc323-2536-4088-9531-058d9bf03c93 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:30.929685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928fc323-2536-4088-9531-058d9bf03c93 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:30.934396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:30.935054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.935361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.935640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] PATH_INFO: `/v3/projects/facd8d39b49144509f6859ee35b1d985/users/31c807a80aed45449a40029352a59aa5/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:30.951452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] RBAC: Authorizing `identity:create_grant(project_id=facd8d39b49144509f6859ee35b1d985, user_id=31c807a80aed45449a40029352a59aa5, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:30.954418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:30.969343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1226/2462] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:43:30 2022] PUT /identity/v3/projects/facd8d39b49144509f6859ee35b1d985/users/31c807a80aed45449a40029352a59aa5/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:43:30.979953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a32eed-2e1e-4ad0-8d20-a49d0f1893ef None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:30.980465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a32eed-2e1e-4ad0-8d20-a49d0f1893ef None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:30.980582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a32eed-2e1e-4ad0-8d20-a49d0f1893ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:31.000203 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-38a32eed-2e1e-4ad0-8d20-a49d0f1893ef None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:31.001431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-38a32eed-2e1e-4ad0-8d20-a49d0f1893ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:31.054166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:31.079434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1237/2463] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:43:31.089232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:31.091503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:31.152645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6d504-abe2-4bb6-ac6f-4fe8ceca9177 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:31.157355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:31.158000 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:31.158291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:31.158571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:31.168105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:31.169555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:31.179747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1227/2464] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:43:37.087301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99beaa-23ca-441d-886d-b111a3e3f324 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:37.087816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99beaa-23ca-441d-886d-b111a3e3f324 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:37.087940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b99beaa-23ca-441d-886d-b111a3e3f324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:37.118721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3b99beaa-23ca-441d-886d-b111a3e3f324 None None] MFA Rules not processed for user `31c807a80aed45449a40029352a59aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:37.119968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3b99beaa-23ca-441d-886d-b111a3e3f324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:37.189806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1238/2465] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:43:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:43:37.204416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:37.206099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:37.217408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:37.288933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea51bea-5b78-428a-8134-0c506d61235f service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:37.294745 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a02cec-f7eb-494a-8973-8749f3956e0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:37.295453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a02cec-f7eb-494a-8973-8749f3956e0b service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:37.295740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a02cec-f7eb-494a-8973-8749f3956e0b service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:37.296016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a02cec-f7eb-494a-8973-8749f3956e0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:37.304658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a02cec-f7eb-494a-8973-8749f3956e0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:37.306312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a02cec-f7eb-494a-8973-8749f3956e0b service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:37.316095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1228/2466] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:43:38.967337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a03007-b4a7-40eb-b3ec-564a6ca23ff7 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:38.968196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a03007-b4a7-40eb-b3ec-564a6ca23ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:38.968470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a03007-b4a7-40eb-b3ec-564a6ca23ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:38.987138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-74a03007-b4a7-40eb-b3ec-564a6ca23ff7 None None] MFA Rules not processed for user `31c807a80aed45449a40029352a59aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:38.988406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-74a03007-b4a7-40eb-b3ec-564a6ca23ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:38.995755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1239/2467] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:43:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:43:43.811271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b08a-8e77-4486-88fc-e5599058540d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:43.811805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b08a-8e77-4486-88fc-e5599058540d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:43.811907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b08a-8e77-4486-88fc-e5599058540d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:43.830750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6023b08a-8e77-4486-88fc-e5599058540d None None] MFA Rules not processed for user `e1382292b43945b4871382306f36772a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:43:43.831973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6023b08a-8e77-4486-88fc-e5599058540d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:43.887838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1229/2468] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:43:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:43:48.982463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=37 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:53.880949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=56 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:43:57.005376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a03007-b4a7-40eb-b3ec-564a6ca23ff7 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:43:57.017758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a03007-b4a7-40eb-b3ec-564a6ca23ff7 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:43:57.022544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd37d9-601f-4efa-b5e8-f275b8b017ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:43:57.023204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd37d9-601f-4efa-b5e8-f275b8b017ea service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:43:57.023496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd37d9-601f-4efa-b5e8-f275b8b017ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:43:57.023778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd37d9-601f-4efa-b5e8-f275b8b017ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:43:57.026136 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-10cd37d9-601f-4efa-b5e8-f275b8b017ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:43:57.038530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd37d9-601f-4efa-b5e8-f275b8b017ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:43:57.040198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd37d9-601f-4efa-b5e8-f275b8b017ea service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:43:57.058252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1240/2469] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:43:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:03.690021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b08a-8e77-4486-88fc-e5599058540d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:03.714182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b08a-8e77-4486-88fc-e5599058540d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:03.722325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:03.722948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:03.723230 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:03.723502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:03.725224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:03.738415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:03.739998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:03.750663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1230/2470] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:04.574216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19286242-d77e-40b1-8135-0aa939ee489b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:04.574725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19286242-d77e-40b1-8135-0aa939ee489b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:04.574831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19286242-d77e-40b1-8135-0aa939ee489b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:04.594648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-19286242-d77e-40b1-8135-0aa939ee489b None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:04.595790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-19286242-d77e-40b1-8135-0aa939ee489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:04.654352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1241/2471] 10.222.0.88 () {58 vars in 967 bytes} [Fri Aug 26 00:44:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:04.694974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:04.696392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:04.766047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca1ae0-c78f-4273-a2ee-342c601076c9 service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:04.771227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1132c-3bee-4360-bb7d-3a78de3319cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:04.771834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1132c-3bee-4360-bb7d-3a78de3319cf service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:04.772121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1132c-3bee-4360-bb7d-3a78de3319cf service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:04.772402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1132c-3bee-4360-bb7d-3a78de3319cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:04.781458 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1132c-3bee-4360-bb7d-3a78de3319cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:04.783096 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1132c-3bee-4360-bb7d-3a78de3319cf service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:04.791505 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1231/2472] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:44:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:44:11.466694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19286242-d77e-40b1-8135-0aa939ee489b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.468188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-19286242-d77e-40b1-8135-0aa939ee489b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:11.484754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19286242-d77e-40b1-8135-0aa939ee489b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:11.489320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:11.489920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:11.490205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:11.490481 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] PATH_INFO: `/v3/users/5f5d594ff9d1454db2c5f4f59cb64e5c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.491612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f5d594ff9d1454db2c5f4f59cb64e5c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.493531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.539110 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f5d594ff9d1454db2c5f4f59cb64e5c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.551787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f5d594ff9d1454db2c5f4f59cb64e5c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.552469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f5d594ff9d1454db2c5f4f59cb64e5c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.560042 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f5d594ff9d1454db2c5f4f59cb64e5c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.567262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f5d594ff9d1454db2c5f4f59cb64e5c'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.573160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1242/2473] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:11 2022] DELETE /identity/v3/users/5f5d594ff9d1454db2c5f4f59cb64e5c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:11.749158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1132c-3bee-4360-bb7d-3a78de3319cf service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.759719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1132c-3bee-4360-bb7d-3a78de3319cf service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:11.817640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:11.818296 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:11.818578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:11.818849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] PATH_INFO: `/v3/projects/201a57e9255e4838b6798e970a95d63b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.819947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] RBAC: Authorizing `identity:delete_project(project_id=201a57e9255e4838b6798e970a95d63b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.821926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.868234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '201a57e9255e4838b6798e970a95d63b', 'request_id': 'req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.873738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '201a57e9255e4838b6798e970a95d63b', 'request_id': 'req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.881764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '201a57e9255e4838b6798e970a95d63b', 'request_id': 'req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.893581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] The token cache is being invalidate because project 201a57e9255e4838b6798e970a95d63b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:11.893868 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.894518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:11.895974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1232/2474] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:11 2022] DELETE /identity/v3/projects/201a57e9255e4838b6798e970a95d63b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:11.899986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:11.901472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:11.916319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd95611a-b4b4-4120-9271-05df0781754d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:11.972516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:11.973149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:11.973431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:11.973706 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] PATH_INFO: `/v3/users/dd9f6c1b2a43430e9d0315fcb448c49d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:11.974869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9f6c1b2a43430e9d0315fcb448c49d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:11.976793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:11.983038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:12.030795 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9f6c1b2a43430e9d0315fcb448c49d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.045177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9f6c1b2a43430e9d0315fcb448c49d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.046025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9f6c1b2a43430e9d0315fcb448c49d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.053666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9f6c1b2a43430e9d0315fcb448c49d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.061219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9f6c1b2a43430e9d0315fcb448c49d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.067084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1243/2475] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:11 2022] DELETE /identity/v3/users/dd9f6c1b2a43430e9d0315fcb448c49d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:12.245018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:12.246913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:12.265755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6a44c-e46e-40f8-8f24-220f3cf3c82b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:12.269789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:12.324195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:12.325259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:12.325535 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:12.325807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] PATH_INFO: `/v3/projects/eaa43da462724d30abccfc0d5b121b98` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:12.326951 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa43da462724d30abccfc0d5b121b98)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:12.328865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:12.373355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa43da462724d30abccfc0d5b121b98', 'request_id': 'req-00445df4-c78c-4c32-8dd6-001ce15b51a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.378825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa43da462724d30abccfc0d5b121b98', 'request_id': 'req-00445df4-c78c-4c32-8dd6-001ce15b51a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.385908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa43da462724d30abccfc0d5b121b98', 'request_id': 'req-00445df4-c78c-4c32-8dd6-001ce15b51a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.397563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] The token cache is being invalidate because project eaa43da462724d30abccfc0d5b121b98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:12.397850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.398504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:12.399948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1233/2476] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:12 2022] DELETE /identity/v3/projects/eaa43da462724d30abccfc0d5b121b98 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:16.780973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:16.782538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:16.856681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4602a0b-e5dc-4f9b-b05d-ab4f1447216d admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:16.921012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:16.921674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:16.922037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:16.922370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:16.924454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:16.949697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:16.995211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:16.997820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:17.009505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1244/2477] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:22.394472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:27.005009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=19 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:31.550487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:31.551908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:31.610224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00445df4-c78c-4c32-8dd6-001ce15b51a4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:31.613995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:31.614607 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:31.614892 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:31.615171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:31.616928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:31.680809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:31.682302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:31.692436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1234/2478] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:34.880183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:34.881987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:34.905258 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c648cf-0585-4bb5-aa54-d041e8250f8c service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:34.911154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:34.911965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:34.912322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:34.912608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] PATH_INFO: `/v3/users/266a34590c4645ffa4c1c4afe3a9970d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:34.913800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=266a34590c4645ffa4c1c4afe3a9970d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:34.915880 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:34.973354 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266a34590c4645ffa4c1c4afe3a9970d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:34.986295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266a34590c4645ffa4c1c4afe3a9970d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:34.987054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266a34590c4645ffa4c1c4afe3a9970d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:34.994977 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266a34590c4645ffa4c1c4afe3a9970d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:35.009038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e1531576-54d7-4a8e-bc8c-092309c75ffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266a34590c4645ffa4c1c4afe3a9970d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:35.015984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1245/2479] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:34 2022] DELETE /identity/v3/users/266a34590c4645ffa4c1c4afe3a9970d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:35.220441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.238240 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a605a-8b56-4b6c-8391-d813ba3a4566 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.301885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.302662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.303043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.303396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] PATH_INFO: `/v3/projects/787fb3699a2f496b8277193250a79f97` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.304649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=787fb3699a2f496b8277193250a79f97)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:35.306734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:35.357375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '787fb3699a2f496b8277193250a79f97', 'request_id': 'req-74d89e5f-27b9-4b86-9a91-ba4392e3d907'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:35.359853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:35.363594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '787fb3699a2f496b8277193250a79f97', 'request_id': 'req-74d89e5f-27b9-4b86-9a91-ba4392e3d907'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:35.372078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '787fb3699a2f496b8277193250a79f97', 'request_id': 'req-74d89e5f-27b9-4b86-9a91-ba4392e3d907'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:35.383888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] The token cache is being invalidate because project 787fb3699a2f496b8277193250a79f97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:35.387610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:35.388275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-74d89e5f-27b9-4b86-9a91-ba4392e3d907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:35.389785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1235/2480] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:35 2022] DELETE /identity/v3/projects/787fb3699a2f496b8277193250a79f97 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:35.394947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13b22-b940-4c1e-9029-7c310e2b55df None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.395242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13b22-b940-4c1e-9029-7c310e2b55df None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.395523 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e13b22-b940-4c1e-9029-7c310e2b55df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.418383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a8e13b22-b940-4c1e-9029-7c310e2b55df None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:35.419539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a8e13b22-b940-4c1e-9029-7c310e2b55df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:35.483231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1246/2481] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:35.492219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd43b0-5fc0-4828-9609-8572a39e96cb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.492509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd43b0-5fc0-4828-9609-8572a39e96cb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.492794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd43b0-5fc0-4828-9609-8572a39e96cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.513948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-12cd43b0-5fc0-4828-9609-8572a39e96cb None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:35.515191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-12cd43b0-5fc0-4828-9609-8572a39e96cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:35.523214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1236/2482] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:35.527963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e13b22-b940-4c1e-9029-7c310e2b55df None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.538775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e13b22-b940-4c1e-9029-7c310e2b55df None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.543958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.544559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.544837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.545108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.545789 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:35.546121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:35.547716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:35.561295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1247/2483] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:35.565870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd43b0-5fc0-4828-9609-8572a39e96cb None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.575748 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd43b0-5fc0-4828-9609-8572a39e96cb None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.580825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1524f-9e4b-41ae-ab70-eb37dc15cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.581437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1524f-9e4b-41ae-ab70-eb37dc15cdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.581723 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1524f-9e4b-41ae-ab70-eb37dc15cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.582039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1524f-9e4b-41ae-ab70-eb37dc15cdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.582671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1524f-9e4b-41ae-ab70-eb37dc15cdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:35.584579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1524f-9e4b-41ae-ab70-eb37dc15cdd6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:35.616839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1237/2484] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:35 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:35.618176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.629700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3218591-cb51-41ec-83ba-801bf0df76bc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.692095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034311a5-57a0-4fbd-b7b5-00b57e5c5165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.692741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034311a5-57a0-4fbd-b7b5-00b57e5c5165 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.693026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034311a5-57a0-4fbd-b7b5-00b57e5c5165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.693306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034311a5-57a0-4fbd-b7b5-00b57e5c5165 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.693973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034311a5-57a0-4fbd-b7b5-00b57e5c5165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:35.696152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034311a5-57a0-4fbd-b7b5-00b57e5c5165 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:35.704688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:35.720271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1248/2485] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:35 2022] POST /identity/v3/users => generated 303 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:35.724605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1524f-9e4b-41ae-ab70-eb37dc15cdd6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.735871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1524f-9e4b-41ae-ab70-eb37dc15cdd6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.740480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079e36e-5aaf-4f40-b3db-02b1a0355892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.741082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e36e-5aaf-4f40-b3db-02b1a0355892 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.741363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e36e-5aaf-4f40-b3db-02b1a0355892 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.741638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2079e36e-5aaf-4f40-b3db-02b1a0355892 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.742328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079e36e-5aaf-4f40-b3db-02b1a0355892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:35.743955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2079e36e-5aaf-4f40-b3db-02b1a0355892 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:35.754846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1238/2486] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:35.758820 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034311a5-57a0-4fbd-b7b5-00b57e5c5165 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.768713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034311a5-57a0-4fbd-b7b5-00b57e5c5165 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.773294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe468f-8e74-4f8b-8e8d-486e83c08045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.773896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe468f-8e74-4f8b-8e8d-486e83c08045 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.774191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe468f-8e74-4f8b-8e8d-486e83c08045 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.774462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe468f-8e74-4f8b-8e8d-486e83c08045 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.775106 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe468f-8e74-4f8b-8e8d-486e83c08045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:35.776704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe468f-8e74-4f8b-8e8d-486e83c08045 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:35.787450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1249/2487] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:35.791568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079e36e-5aaf-4f40-b3db-02b1a0355892 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:35.802105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2079e36e-5aaf-4f40-b3db-02b1a0355892 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:35.806681 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9de4d2-89ed-40b5-adc0-8a5baa2d4358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:35.807316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9de4d2-89ed-40b5-adc0-8a5baa2d4358 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.808354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9de4d2-89ed-40b5-adc0-8a5baa2d4358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.808631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9de4d2-89ed-40b5-adc0-8a5baa2d4358 admin admin] PATH_INFO: `/v3/projects/01b840894b634207b67b9035f81231b7/users/49596263f4f440638aaf83b1cee14220/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.822895 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9de4d2-89ed-40b5-adc0-8a5baa2d4358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01b840894b634207b67b9035f81231b7, user_id=49596263f4f440638aaf83b1cee14220, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:35.825706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9de4d2-89ed-40b5-adc0-8a5baa2d4358 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:35.838166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1239/2488] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:35 2022] PUT /identity/v3/projects/01b840894b634207b67b9035f81231b7/users/49596263f4f440638aaf83b1cee14220/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:35.848229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b459-7fab-44b8-bad5-990a90be2737 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:35.848521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b459-7fab-44b8-bad5-990a90be2737 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:35.848797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9b459-7fab-44b8-bad5-990a90be2737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:35.877718 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-33b9b459-7fab-44b8-bad5-990a90be2737 None None] MFA Rules not processed for user `49596263f4f440638aaf83b1cee14220`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:35.878973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-33b9b459-7fab-44b8-bad5-990a90be2737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:35.943189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1250/2489] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:35 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:35.947586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9de4d2-89ed-40b5-adc0-8a5baa2d4358 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.009371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9de4d2-89ed-40b5-adc0-8a5baa2d4358 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.014213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f8425-ef9e-446d-90ce-ed9f634a0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.014822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f8425-ef9e-446d-90ce-ed9f634a0895 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.015099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f8425-ef9e-446d-90ce-ed9f634a0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.015372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f8425-ef9e-446d-90ce-ed9f634a0895 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.015992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f8425-ef9e-446d-90ce-ed9f634a0895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.017914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f8425-ef9e-446d-90ce-ed9f634a0895 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.056312 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1240/2490] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:35 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:36.061013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9b459-7fab-44b8-bad5-990a90be2737 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.087875 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9b459-7fab-44b8-bad5-990a90be2737 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.149538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914244c5-2424-41e7-bcf1-cf555ac51226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.150189 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914244c5-2424-41e7-bcf1-cf555ac51226 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.150475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914244c5-2424-41e7-bcf1-cf555ac51226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.150753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914244c5-2424-41e7-bcf1-cf555ac51226 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.151915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914244c5-2424-41e7-bcf1-cf555ac51226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.153829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914244c5-2424-41e7-bcf1-cf555ac51226 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.175805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1251/2491] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:36 2022] POST /identity/v3/users => generated 309 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:36.179729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f8425-ef9e-446d-90ce-ed9f634a0895 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.190524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f8425-ef9e-446d-90ce-ed9f634a0895 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.195277 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3074-9c11-4d4a-8f61-48fff42f7230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.195821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3074-9c11-4d4a-8f61-48fff42f7230 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.196104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3074-9c11-4d4a-8f61-48fff42f7230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.196379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb3074-9c11-4d4a-8f61-48fff42f7230 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.197051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb3074-9c11-4d4a-8f61-48fff42f7230 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.198904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb3074-9c11-4d4a-8f61-48fff42f7230 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.210073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1241/2492] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:36.214623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914244c5-2424-41e7-bcf1-cf555ac51226 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.231995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914244c5-2424-41e7-bcf1-cf555ac51226 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.236856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554e0c-e65e-498a-b841-f67a32e401cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.237519 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554e0c-e65e-498a-b841-f67a32e401cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.237802 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554e0c-e65e-498a-b841-f67a32e401cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.238114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b554e0c-e65e-498a-b841-f67a32e401cd admin admin] PATH_INFO: `/v3/projects/d32f4474831d45b2bd2217312c9a3d3f/users/a517a0517e8e4c3ba3614554b6af5570/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.252889 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b554e0c-e65e-498a-b841-f67a32e401cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32f4474831d45b2bd2217312c9a3d3f, user_id=a517a0517e8e4c3ba3614554b6af5570, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.255579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b554e0c-e65e-498a-b841-f67a32e401cd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.268590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1252/2493] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:36 2022] PUT /identity/v3/projects/d32f4474831d45b2bd2217312c9a3d3f/users/a517a0517e8e4c3ba3614554b6af5570/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:36.278543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3074-9c11-4d4a-8f61-48fff42f7230 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.289111 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb3074-9c11-4d4a-8f61-48fff42f7230 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.338078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:36.349895 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef274edb-7727-4ee8-9e4b-315a652ce732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.350506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274edb-7727-4ee8-9e4b-315a652ce732 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.350790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274edb-7727-4ee8-9e4b-315a652ce732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.351067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef274edb-7727-4ee8-9e4b-315a652ce732 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.351707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef274edb-7727-4ee8-9e4b-315a652ce732 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.353304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef274edb-7727-4ee8-9e4b-315a652ce732 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.363827 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1242/2494] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:36.368183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554e0c-e65e-498a-b841-f67a32e401cd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.378554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b554e0c-e65e-498a-b841-f67a32e401cd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.383179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.383826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.384111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.384390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] PATH_INFO: `/v3/projects/d32f4474831d45b2bd2217312c9a3d3f/users/a517a0517e8e4c3ba3614554b6af5570/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.387148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d32f4474831d45b2bd2217312c9a3d3f, user_id=a517a0517e8e4c3ba3614554b6af5570, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.389800 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.399936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1253/2495] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:36 2022] PUT /identity/v3/projects/d32f4474831d45b2bd2217312c9a3d3f/users/a517a0517e8e4c3ba3614554b6af5570/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:36.412182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7e30c-9604-4794-9b1a-c51776ef39ce None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.412475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7e30c-9604-4794-9b1a-c51776ef39ce None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.412756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae7e30c-9604-4794-9b1a-c51776ef39ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.445562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4ae7e30c-9604-4794-9b1a-c51776ef39ce None None] MFA Rules not processed for user `a517a0517e8e4c3ba3614554b6af5570`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:36.446914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4ae7e30c-9604-4794-9b1a-c51776ef39ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:36.528216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1243/2496] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:36.539921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.541906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:36.568516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:36.612185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce47fd1-44d2-46cc-a890-1ffd50bb8c61 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.617159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8aeaa0e-818c-4762-bba6-49c0f1ac40eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.618180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeaa0e-818c-4762-bba6-49c0f1ac40eb service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.618586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeaa0e-818c-4762-bba6-49c0f1ac40eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.618950 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8aeaa0e-818c-4762-bba6-49c0f1ac40eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.630179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aeaa0e-818c-4762-bba6-49c0f1ac40eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.631631 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8aeaa0e-818c-4762-bba6-49c0f1ac40eb service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.641939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1254/2497] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:36 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:36.788754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7e30c-9604-4794-9b1a-c51776ef39ce None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:36.850494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae7e30c-9604-4794-9b1a-c51776ef39ce None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:36.855414 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:36.856044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.856390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.856673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] PATH_INFO: `/v3/users/49596263f4f440638aaf83b1cee14220` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.857824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49596263f4f440638aaf83b1cee14220)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:36.859802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:36.910727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49596263f4f440638aaf83b1cee14220'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:36.911393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49596263f4f440638aaf83b1cee14220'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:36.919891 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49596263f4f440638aaf83b1cee14220'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:36.927467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49596263f4f440638aaf83b1cee14220'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:36.936551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:36.941610 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49596263f4f440638aaf83b1cee14220'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:36.949293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1244/2498] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:36 2022] DELETE /identity/v3/users/49596263f4f440638aaf83b1cee14220 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:36.953849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5476-587c-4c44-be0e-18a099e18713 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:36.954397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5476-587c-4c44-be0e-18a099e18713 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:36.954504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de5476-587c-4c44-be0e-18a099e18713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:36.974533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-69de5476-587c-4c44-be0e-18a099e18713 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:36.975751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-69de5476-587c-4c44-be0e-18a099e18713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:37.038422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1255/2499] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:37.049431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.050922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:37.115469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4820f616-85c9-4d2b-9ebc-d4c3b5f22970 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.119186 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba33f8-af7e-454b-9ba0-49a29272f9b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.119978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba33f8-af7e-454b-9ba0-49a29272f9b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.120766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba33f8-af7e-454b-9ba0-49a29272f9b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.121287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba33f8-af7e-454b-9ba0-49a29272f9b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.131541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba33f8-af7e-454b-9ba0-49a29272f9b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:37.133263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba33f8-af7e-454b-9ba0-49a29272f9b7 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:37.144658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1245/2500] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:37.441313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de5476-587c-4c44-be0e-18a099e18713 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.443290 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-69de5476-587c-4c44-be0e-18a099e18713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:37.460525 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de5476-587c-4c44-be0e-18a099e18713 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.474634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.475386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.475674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.475949 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] PATH_INFO: `/v3/projects/01b840894b634207b67b9035f81231b7` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.477140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01b840894b634207b67b9035f81231b7)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:37.479272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:37.532231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01b840894b634207b67b9035f81231b7', 'request_id': 'req-8edb7186-f14f-4f68-942b-291886cca499'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.539297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01b840894b634207b67b9035f81231b7', 'request_id': 'req-8edb7186-f14f-4f68-942b-291886cca499'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.547868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01b840894b634207b67b9035f81231b7', 'request_id': 'req-8edb7186-f14f-4f68-942b-291886cca499'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.559444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] The token cache is being invalidate because project 01b840894b634207b67b9035f81231b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:37.559756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.560669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.562537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1256/2501] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:37 2022] DELETE /identity/v3/projects/01b840894b634207b67b9035f81231b7 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:37.567278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba33f8-af7e-454b-9ba0-49a29272f9b7 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:37.581783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba33f8-af7e-454b-9ba0-49a29272f9b7 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:37.643297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:37.643922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:37.644203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:37.644478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] PATH_INFO: `/v3/users/a517a0517e8e4c3ba3614554b6af5570` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:37.645605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a517a0517e8e4c3ba3614554b6af5570)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:37.647562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:37.703744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a517a0517e8e4c3ba3614554b6af5570'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.705043 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a517a0517e8e4c3ba3614554b6af5570'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.715719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a517a0517e8e4c3ba3614554b6af5570'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.724744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a517a0517e8e4c3ba3614554b6af5570'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.740808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-62331e44-36a7-405c-b459-e09505a371fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a517a0517e8e4c3ba3614554b6af5570'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:37.754589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1246/2502] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:37 2022] DELETE /identity/v3/users/a517a0517e8e4c3ba3614554b6af5570 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:38.024841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.027055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:38.042503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edb7186-f14f-4f68-942b-291886cca499 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.089414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.103269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.103897 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.104238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.104548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] PATH_INFO: `/v3/projects/d32f4474831d45b2bd2217312c9a3d3f` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.106226 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d32f4474831d45b2bd2217312c9a3d3f)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.108177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.154691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd32f4474831d45b2bd2217312c9a3d3f', 'request_id': 'req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:38.160900 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd32f4474831d45b2bd2217312c9a3d3f', 'request_id': 'req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:38.168060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd32f4474831d45b2bd2217312c9a3d3f', 'request_id': 'req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:38.178351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] The token cache is being invalidate because project d32f4474831d45b2bd2217312c9a3d3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:38.178646 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:38.179267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2cac3303-aeb7-4f5d-9675-5b2a29e37a09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:38.180786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1257/2503] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:38 2022] DELETE /identity/v3/projects/d32f4474831d45b2bd2217312c9a3d3f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:38.186567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaab75-d9e6-4301-9775-f61578803f59 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.186859 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaab75-d9e6-4301-9775-f61578803f59 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.187143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfaab75-d9e6-4301-9775-f61578803f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.209493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-3dfaab75-d9e6-4301-9775-f61578803f59 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:38.210909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3dfaab75-d9e6-4301-9775-f61578803f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:38.220127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.275309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1247/2504] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:38.283899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56fde-d8ab-49c1-b163-a4767b7e7e38 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.284182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56fde-d8ab-49c1-b163-a4767b7e7e38 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.284451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b56fde-d8ab-49c1-b163-a4767b7e7e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.304077 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-49b56fde-d8ab-49c1-b163-a4767b7e7e38 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:38.305391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-49b56fde-d8ab-49c1-b163-a4767b7e7e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:38.314043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1258/2505] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:38.318228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaab75-d9e6-4301-9775-f61578803f59 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.328801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfaab75-d9e6-4301-9775-f61578803f59 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.334302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.334908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.335192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.335472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.336131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:38.336443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.338097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.351042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1248/2506] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:38.355397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56fde-d8ab-49c1-b163-a4767b7e7e38 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.364725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b56fde-d8ab-49c1-b163-a4767b7e7e38 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.369426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc6e0-de21-47cd-96cc-ace23f712ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.370615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc6e0-de21-47cd-96cc-ace23f712ef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.370888 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc6e0-de21-47cd-96cc-ace23f712ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.371275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8fc6e0-de21-47cd-96cc-ace23f712ef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.371896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc6e0-de21-47cd-96cc-ace23f712ef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.373782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8fc6e0-de21-47cd-96cc-ace23f712ef0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.403113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1259/2507] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:44:38.407366 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.418747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1d6036-ddb4-4ca3-b7ee-0ecf97b1758d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.475072 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4206-2956-4019-a3a7-60cec1a7db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.475601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4206-2956-4019-a3a7-60cec1a7db08 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.475882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4206-2956-4019-a3a7-60cec1a7db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.476157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e4206-2956-4019-a3a7-60cec1a7db08 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.476783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4206-2956-4019-a3a7-60cec1a7db08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.478796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e4206-2956-4019-a3a7-60cec1a7db08 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.499952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1249/2508] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:38.504193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc6e0-de21-47cd-96cc-ace23f712ef0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.514571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8fc6e0-de21-47cd-96cc-ace23f712ef0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.519147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3997022-f42e-4b6e-8a7a-c50a5e287169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.519737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997022-f42e-4b6e-8a7a-c50a5e287169 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.520013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997022-f42e-4b6e-8a7a-c50a5e287169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.520284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3997022-f42e-4b6e-8a7a-c50a5e287169 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.520949 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3997022-f42e-4b6e-8a7a-c50a5e287169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.522575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3997022-f42e-4b6e-8a7a-c50a5e287169 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.533104 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1260/2509] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:38.537249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4206-2956-4019-a3a7-60cec1a7db08 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.547839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e4206-2956-4019-a3a7-60cec1a7db08 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.552734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561f777-b60c-42e9-bc0e-9730327c2a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.553435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f777-b60c-42e9-bc0e-9730327c2a9a admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.553758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f777-b60c-42e9-bc0e-9730327c2a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.554073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561f777-b60c-42e9-bc0e-9730327c2a9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.554784 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561f777-b60c-42e9-bc0e-9730327c2a9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.556416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4561f777-b60c-42e9-bc0e-9730327c2a9a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.569857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1250/2510] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:38.575019 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3997022-f42e-4b6e-8a7a-c50a5e287169 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.587133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3997022-f42e-4b6e-8a7a-c50a5e287169 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.592399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954836-fdbf-4026-996d-7440e32adeb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.593044 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954836-fdbf-4026-996d-7440e32adeb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.593323 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954836-fdbf-4026-996d-7440e32adeb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.593595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954836-fdbf-4026-996d-7440e32adeb0 admin admin] PATH_INFO: `/v3/projects/81321389757047079c7c34becb3fbeca/users/e794bd1344fd4f42a9dad61fee0d13ea/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.607852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954836-fdbf-4026-996d-7440e32adeb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81321389757047079c7c34becb3fbeca, user_id=e794bd1344fd4f42a9dad61fee0d13ea, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.610539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31954836-fdbf-4026-996d-7440e32adeb0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.625431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1261/2511] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:38 2022] PUT /identity/v3/projects/81321389757047079c7c34becb3fbeca/users/e794bd1344fd4f42a9dad61fee0d13ea/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:38.636124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45444da-cb3b-46de-8c71-50f363768b5d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.636461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45444da-cb3b-46de-8c71-50f363768b5d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.636742 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45444da-cb3b-46de-8c71-50f363768b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.665554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e45444da-cb3b-46de-8c71-50f363768b5d None None] MFA Rules not processed for user `e794bd1344fd4f42a9dad61fee0d13ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:38.666951 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e45444da-cb3b-46de-8c71-50f363768b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:38.736010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1251/2512] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:38.740562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954836-fdbf-4026-996d-7440e32adeb0 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.807456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31954836-fdbf-4026-996d-7440e32adeb0 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.812764 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1f121-4362-4a12-b625-700b4b5755ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.813463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1f121-4362-4a12-b625-700b4b5755ec admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.813719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1f121-4362-4a12-b625-700b4b5755ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.814673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc1f121-4362-4a12-b625-700b4b5755ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.814799 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1f121-4362-4a12-b625-700b4b5755ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.816724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc1f121-4362-4a12-b625-700b4b5755ec admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.846158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.859870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1262/2513] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:38.861026 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45444da-cb3b-46de-8c71-50f363768b5d None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:38.876172 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45444da-cb3b-46de-8c71-50f363768b5d None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:38.883394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:38.953006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfff61-1166-4309-b5e7-dfd07872a679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:38.953830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfff61-1166-4309-b5e7-dfd07872a679 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:38.954227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfff61-1166-4309-b5e7-dfd07872a679 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:38.954572 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfff61-1166-4309-b5e7-dfd07872a679 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:38.955271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfff61-1166-4309-b5e7-dfd07872a679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:38.957455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfff61-1166-4309-b5e7-dfd07872a679 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:38.984517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1252/2514] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:38 2022] POST /identity/v3/users => generated 290 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:38.988410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1f121-4362-4a12-b625-700b4b5755ec admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.001400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc1f121-4362-4a12-b625-700b4b5755ec admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.007497 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7735998-463d-479f-899e-76042ff13775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.008190 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7735998-463d-479f-899e-76042ff13775 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.008479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7735998-463d-479f-899e-76042ff13775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.008753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7735998-463d-479f-899e-76042ff13775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.009405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7735998-463d-479f-899e-76042ff13775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.011618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7735998-463d-479f-899e-76042ff13775 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.025545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1263/2515] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:39.026764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfff61-1166-4309-b5e7-dfd07872a679 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.038657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfff61-1166-4309-b5e7-dfd07872a679 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.045335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2e225-629a-427b-acff-7acfecfa5ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.046302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2e225-629a-427b-acff-7acfecfa5ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.046864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2e225-629a-427b-acff-7acfecfa5ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.047322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2e225-629a-427b-acff-7acfecfa5ac4 admin admin] PATH_INFO: `/v3/projects/03b5fb9c90314316b578168921d92996/users/3b854469d1bd4ea898fd833cba487c0d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.067980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2e225-629a-427b-acff-7acfecfa5ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b5fb9c90314316b578168921d92996, user_id=3b854469d1bd4ea898fd833cba487c0d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.072139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f2e225-629a-427b-acff-7acfecfa5ac4 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.087383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1253/2516] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:39 2022] PUT /identity/v3/projects/03b5fb9c90314316b578168921d92996/users/3b854469d1bd4ea898fd833cba487c0d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:39.091302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7735998-463d-479f-899e-76042ff13775 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.101309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7735998-463d-479f-899e-76042ff13775 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.158763 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0b6a0-8b19-4715-b583-bb436f3416e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.159369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0b6a0-8b19-4715-b583-bb436f3416e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.159649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0b6a0-8b19-4715-b583-bb436f3416e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.160043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0b6a0-8b19-4715-b583-bb436f3416e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.160690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0b6a0-8b19-4715-b583-bb436f3416e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.162352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0b6a0-8b19-4715-b583-bb436f3416e4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.175659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1264/2517] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:39.176818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2e225-629a-427b-acff-7acfecfa5ac4 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.188058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2e225-629a-427b-acff-7acfecfa5ac4 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.192719 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.193383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.193668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.193988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] PATH_INFO: `/v3/projects/03b5fb9c90314316b578168921d92996/users/3b854469d1bd4ea898fd833cba487c0d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.195906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03b5fb9c90314316b578168921d92996, user_id=3b854469d1bd4ea898fd833cba487c0d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.199245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.213833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1254/2518] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:39 2022] PUT /identity/v3/projects/03b5fb9c90314316b578168921d92996/users/3b854469d1bd4ea898fd833cba487c0d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:39.229303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee00c-7492-43ee-8c10-f657a02d161b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.229599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee00c-7492-43ee-8c10-f657a02d161b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.229903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ee00c-7492-43ee-8c10-f657a02d161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.258018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-0a3ee00c-7492-43ee-8c10-f657a02d161b None None] MFA Rules not processed for user `3b854469d1bd4ea898fd833cba487c0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:39.259242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0a3ee00c-7492-43ee-8c10-f657a02d161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:39.327309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1265/2519] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:39.338660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.340469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:39.405173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7430479-cef5-4638-805c-1a6c6782ec75 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.409368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a470a0-5e78-4e9d-8d29-3886879f2a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.410023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a470a0-5e78-4e9d-8d29-3886879f2a8d service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.410326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a470a0-5e78-4e9d-8d29-3886879f2a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.410573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a470a0-5e78-4e9d-8d29-3886879f2a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.421221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a470a0-5e78-4e9d-8d29-3886879f2a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.422765 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a470a0-5e78-4e9d-8d29-3886879f2a8d service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.433150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1255/2520] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:39.479807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ee00c-7492-43ee-8c10-f657a02d161b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:39.481584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-0a3ee00c-7492-43ee-8c10-f657a02d161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:39.493772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ee00c-7492-43ee-8c10-f657a02d161b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:39.498491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d9bcc-1d08-4009-b678-c7e3bb06c558 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:39.499105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d9bcc-1d08-4009-b678-c7e3bb06c558 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:39.499391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d9bcc-1d08-4009-b678-c7e3bb06c558 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:39.499668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d9bcc-1d08-4009-b678-c7e3bb06c558 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:39.562554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d9bcc-1d08-4009-b678-c7e3bb06c558 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:39.564375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d9bcc-1d08-4009-b678-c7e3bb06c558 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:39.577272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1266/2521] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:42.903733 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a470a0-5e78-4e9d-8d29-3886879f2a8d service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:42.970626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a470a0-5e78-4e9d-8d29-3886879f2a8d service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:42.975328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:42.975953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:42.976235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:42.976510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] PATH_INFO: `/v3/users/e794bd1344fd4f42a9dad61fee0d13ea` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:42.977625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e794bd1344fd4f42a9dad61fee0d13ea)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:42.979625 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:42.986431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:43.042146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e794bd1344fd4f42a9dad61fee0d13ea'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.042816 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e794bd1344fd4f42a9dad61fee0d13ea'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.050149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e794bd1344fd4f42a9dad61fee0d13ea'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.059547 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e794bd1344fd4f42a9dad61fee0d13ea'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.072126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e794bd1344fd4f42a9dad61fee0d13ea'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.079185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1256/2522] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:42 2022] DELETE /identity/v3/users/e794bd1344fd4f42a9dad61fee0d13ea => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:43.083869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9bde-6b25-4de9-8481-7194ec12b9fa None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.084367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9bde-6b25-4de9-8481-7194ec12b9fa None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.084512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ff9bde-6b25-4de9-8481-7194ec12b9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.097999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:43.104940 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-50ff9bde-6b25-4de9-8481-7194ec12b9fa None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:43.106274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-50ff9bde-6b25-4de9-8481-7194ec12b9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:43.169587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1267/2523] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:44:43.179348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:43.180879 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:43.242684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becf3d4c-7286-4634-a81c-0210aba5001f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:43.247651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c7a80-b127-44fc-b4e1-8b77977162b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:43.248315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7a80-b127-44fc-b4e1-8b77977162b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.248606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7a80-b127-44fc-b4e1-8b77977162b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.248887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c7a80-b127-44fc-b4e1-8b77977162b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.258780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c7a80-b127-44fc-b4e1-8b77977162b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:43.260247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569c7a80-b127-44fc-b4e1-8b77977162b8 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:43.270394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1257/2524] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:43.572145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff9bde-6b25-4de9-8481-7194ec12b9fa None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:43.574999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-50ff9bde-6b25-4de9-8481-7194ec12b9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:43.589374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ff9bde-6b25-4de9-8481-7194ec12b9fa None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:43.594159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:43.594915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.595265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.595603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] PATH_INFO: `/v3/projects/81321389757047079c7c34becb3fbeca` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.596818 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] RBAC: Authorizing `identity:delete_project(project_id=81321389757047079c7c34becb3fbeca)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:43.598867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:43.655855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81321389757047079c7c34becb3fbeca', 'request_id': 'req-b9cce04d-eff6-413f-913f-d62de333401e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.662120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81321389757047079c7c34becb3fbeca', 'request_id': 'req-b9cce04d-eff6-413f-913f-d62de333401e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.669955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81321389757047079c7c34becb3fbeca', 'request_id': 'req-b9cce04d-eff6-413f-913f-d62de333401e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.680095 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] The token cache is being invalidate because project 81321389757047079c7c34becb3fbeca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:43.680387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.681013 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.683362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1268/2525] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:43 2022] DELETE /identity/v3/projects/81321389757047079c7c34becb3fbeca => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:43.687345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c7a80-b127-44fc-b4e1-8b77977162b8 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:43.697012 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c7a80-b127-44fc-b4e1-8b77977162b8 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:43.754819 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:43.755449 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:43.755737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:43.756015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] PATH_INFO: `/v3/users/3b854469d1bd4ea898fd833cba487c0d` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:43.757144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b854469d1bd4ea898fd833cba487c0d)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:43.759117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:43.788328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:43.809795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b854469d1bd4ea898fd833cba487c0d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.810472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b854469d1bd4ea898fd833cba487c0d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.818516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b854469d1bd4ea898fd833cba487c0d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.825629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b854469d1bd4ea898fd833cba487c0d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.837847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-11300772-20a9-456b-92ff-2f38f42abec6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b854469d1bd4ea898fd833cba487c0d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:43.844081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1258/2526] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:43 2022] DELETE /identity/v3/users/3b854469d1bd4ea898fd833cba487c0d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:44.144295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.145808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:44.160406 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cce04d-eff6-413f-913f-d62de333401e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.221690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.222505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.222876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.223191 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] PATH_INFO: `/v3/projects/03b5fb9c90314316b578168921d92996` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.224430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03b5fb9c90314316b578168921d92996)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.226715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.261930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:44.276583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03b5fb9c90314316b578168921d92996', 'request_id': 'req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:44.282672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03b5fb9c90314316b578168921d92996', 'request_id': 'req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:44.290244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03b5fb9c90314316b578168921d92996', 'request_id': 'req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:44.301257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] The token cache is being invalidate because project 03b5fb9c90314316b578168921d92996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:44.301576 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:44.302225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ef498d5f-2190-4a4a-b6b6-7871ba2d5d2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:44.303717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1269/2527] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:44 2022] DELETE /identity/v3/projects/03b5fb9c90314316b578168921d92996 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:44.308838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18d8e3-b158-4e85-86dc-6d3d4308e3d0 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.309323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18d8e3-b158-4e85-86dc-6d3d4308e3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.309416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18d8e3-b158-4e85-86dc-6d3d4308e3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.328980 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-fa18d8e3-b158-4e85-86dc-6d3d4308e3d0 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:44.330204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fa18d8e3-b158-4e85-86dc-6d3d4308e3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:44.388549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1259/2528] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:44.396414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f31f7-ed87-4604-998a-ca747c0635a3 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.396705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f31f7-ed87-4604-998a-ca747c0635a3 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.396983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f31f7-ed87-4604-998a-ca747c0635a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.418002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a50f31f7-ed87-4604-998a-ca747c0635a3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:44.419132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a50f31f7-ed87-4604-998a-ca747c0635a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:44.427014 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1270/2529] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:44.431250 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18d8e3-b158-4e85-86dc-6d3d4308e3d0 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.440978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18d8e3-b158-4e85-86dc-6d3d4308e3d0 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.445526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.446174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.446461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.446767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.447415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:44.447849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.449470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.460900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1260/2530] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:44.466102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f31f7-ed87-4604-998a-ca747c0635a3 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.475239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f31f7-ed87-4604-998a-ca747c0635a3 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.481371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c03ce-0094-4cc5-ac66-fa96d4142d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.482012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c03ce-0094-4cc5-ac66-fa96d4142d79 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.482296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c03ce-0094-4cc5-ac66-fa96d4142d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.482567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c03ce-0094-4cc5-ac66-fa96d4142d79 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.483200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c03ce-0094-4cc5-ac66-fa96d4142d79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.485108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c03ce-0094-4cc5-ac66-fa96d4142d79 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.519602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1271/2531] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:44 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:44:44.520717 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.531287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d1e22-ae84-425f-8096-d3fa55d001b0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.594093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40662517-1d27-4ff7-8086-c9825f528a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.594669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662517-1d27-4ff7-8086-c9825f528a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.594956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662517-1d27-4ff7-8086-c9825f528a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.595231 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662517-1d27-4ff7-8086-c9825f528a39 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.595867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40662517-1d27-4ff7-8086-c9825f528a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.597791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40662517-1d27-4ff7-8086-c9825f528a39 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.623509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1261/2532] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:44 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:44:44.627537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c03ce-0094-4cc5-ac66-fa96d4142d79 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.641124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c03ce-0094-4cc5-ac66-fa96d4142d79 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.643405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4e9d-9e8f-4164-8d8f-dbb83b4367da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.644116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4e9d-9e8f-4164-8d8f-dbb83b4367da admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.644474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4e9d-9e8f-4164-8d8f-dbb83b4367da admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.644824 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4e9d-9e8f-4164-8d8f-dbb83b4367da admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.645553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a4e9d-9e8f-4164-8d8f-dbb83b4367da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.647505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a4e9d-9e8f-4164-8d8f-dbb83b4367da admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.658869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1272/2533] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:44:44.662943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40662517-1d27-4ff7-8086-c9825f528a39 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.673522 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40662517-1d27-4ff7-8086-c9825f528a39 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.678219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624e0c8-471c-4993-9203-dd25837e8faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.678889 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e0c8-471c-4993-9203-dd25837e8faf admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.679243 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e0c8-471c-4993-9203-dd25837e8faf admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.679660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624e0c8-471c-4993-9203-dd25837e8faf admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.682876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e0c8-471c-4993-9203-dd25837e8faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.684633 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7624e0c8-471c-4993-9203-dd25837e8faf admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.695995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1262/2534] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:44.700267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4e9d-9e8f-4164-8d8f-dbb83b4367da admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.710368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a4e9d-9e8f-4164-8d8f-dbb83b4367da admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.715195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3f1b3-0797-4522-8f0b-73361f4d6292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.715847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3f1b3-0797-4522-8f0b-73361f4d6292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.716127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3f1b3-0797-4522-8f0b-73361f4d6292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.716397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f3f1b3-0797-4522-8f0b-73361f4d6292 admin admin] PATH_INFO: `/v3/projects/90a605d7eb02418f98ba42ce4fbdb550/users/8a7cc7aaeed843e7a8dbba01178a8c0f/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.732484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3f1b3-0797-4522-8f0b-73361f4d6292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90a605d7eb02418f98ba42ce4fbdb550, user_id=8a7cc7aaeed843e7a8dbba01178a8c0f, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.735230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f3f1b3-0797-4522-8f0b-73361f4d6292 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.749721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1273/2535] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:44 2022] PUT /identity/v3/projects/90a605d7eb02418f98ba42ce4fbdb550/users/8a7cc7aaeed843e7a8dbba01178a8c0f/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:44.760234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0735cf-5d94-4f42-937a-93842cfa3da4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.760702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0735cf-5d94-4f42-937a-93842cfa3da4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.761076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0735cf-5d94-4f42-937a-93842cfa3da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.782327 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:44.791914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0a0735cf-5d94-4f42-937a-93842cfa3da4 None None] MFA Rules not processed for user `8a7cc7aaeed843e7a8dbba01178a8c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:44.794376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0a0735cf-5d94-4f42-937a-93842cfa3da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:44.862603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1263/2536] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:44.866948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3f1b3-0797-4522-8f0b-73361f4d6292 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.933363 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f3f1b3-0797-4522-8f0b-73361f4d6292 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:44.938089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba79c-fa76-4bbf-96fa-a5d4128860fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:44.938722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba79c-fa76-4bbf-96fa-a5d4128860fd admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:44.939023 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba79c-fa76-4bbf-96fa-a5d4128860fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:44.939279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ba79c-fa76-4bbf-96fa-a5d4128860fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:44.939909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ba79c-fa76-4bbf-96fa-a5d4128860fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:44.942043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0ba79c-fa76-4bbf-96fa-a5d4128860fd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:44.975772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1274/2537] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:44 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:44.981076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0735cf-5d94-4f42-937a-93842cfa3da4 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:44.995003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0735cf-5d94-4f42-937a-93842cfa3da4 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.056357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f697e-94b9-4231-becb-705b67679930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.057131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f697e-94b9-4231-becb-705b67679930 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.057492 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f697e-94b9-4231-becb-705b67679930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.057833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f697e-94b9-4231-becb-705b67679930 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.058555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f697e-94b9-4231-becb-705b67679930 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.060604 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793f697e-94b9-4231-becb-705b67679930 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.086371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1264/2538] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:44 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:45.087767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba79c-fa76-4bbf-96fa-a5d4128860fd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.099193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ba79c-fa76-4bbf-96fa-a5d4128860fd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.104777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bdbc2-8e0d-48cf-b72d-290d86a611c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.105637 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdbc2-8e0d-48cf-b72d-290d86a611c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.105964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdbc2-8e0d-48cf-b72d-290d86a611c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.106245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4bdbc2-8e0d-48cf-b72d-290d86a611c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.107055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bdbc2-8e0d-48cf-b72d-290d86a611c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.109740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4bdbc2-8e0d-48cf-b72d-290d86a611c2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.123937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1275/2539] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:45.125273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f697e-94b9-4231-becb-705b67679930 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.136044 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793f697e-94b9-4231-becb-705b67679930 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.140990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8c2c5-3346-43a8-b2a8-21634664a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.141691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c2c5-3346-43a8-b2a8-21634664a7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.142769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c2c5-3346-43a8-b2a8-21634664a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.143119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8c2c5-3346-43a8-b2a8-21634664a7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.143842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8c2c5-3346-43a8-b2a8-21634664a7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.145514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8c2c5-3346-43a8-b2a8-21634664a7e7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.156609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1265/2540] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:45.161166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bdbc2-8e0d-48cf-b72d-290d86a611c2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.173208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4bdbc2-8e0d-48cf-b72d-290d86a611c2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.178431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408647-6b86-4607-a1aa-81ff8b481572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.179091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408647-6b86-4607-a1aa-81ff8b481572 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.179377 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408647-6b86-4607-a1aa-81ff8b481572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.179659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408647-6b86-4607-a1aa-81ff8b481572 admin admin] PATH_INFO: `/v3/projects/b417238b441a4210851eb00896789549/users/190eff0c15274047a518ac821dbb2b8b/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.197145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26408647-6b86-4607-a1aa-81ff8b481572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b417238b441a4210851eb00896789549, user_id=190eff0c15274047a518ac821dbb2b8b, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.200446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26408647-6b86-4607-a1aa-81ff8b481572 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.221442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1276/2541] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:45 2022] PUT /identity/v3/projects/b417238b441a4210851eb00896789549/users/190eff0c15274047a518ac821dbb2b8b/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:45.233766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02be8-5c78-4c48-931e-f38789be3647 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.234168 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02be8-5c78-4c48-931e-f38789be3647 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.234506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e02be8-5c78-4c48-931e-f38789be3647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.262136 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-10e02be8-5c78-4c48-931e-f38789be3647 None None] MFA Rules not processed for user `190eff0c15274047a518ac821dbb2b8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:45.263360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-10e02be8-5c78-4c48-931e-f38789be3647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:45.335141 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1266/2542] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:45 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:45.340711 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408647-6b86-4607-a1aa-81ff8b481572 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.351805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:45.408278 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408647-6b86-4607-a1aa-81ff8b481572 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.413033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a49b45-3bfd-4d92-b957-267a185c9b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.413636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a49b45-3bfd-4d92-b957-267a185c9b6e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.413959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a49b45-3bfd-4d92-b957-267a185c9b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.414242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a49b45-3bfd-4d92-b957-267a185c9b6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.414864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a49b45-3bfd-4d92-b957-267a185c9b6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.416856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a49b45-3bfd-4d92-b957-267a185c9b6e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.442384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1277/2543] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:45 2022] POST /identity/v3/projects => generated 379 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:45.446359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02be8-5c78-4c48-931e-f38789be3647 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.458130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e02be8-5c78-4c48-931e-f38789be3647 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.462728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:45.517590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13538473-796a-412d-b8f1-7bdfc6d42970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.518241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13538473-796a-412d-b8f1-7bdfc6d42970 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.518509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13538473-796a-412d-b8f1-7bdfc6d42970 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.518782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13538473-796a-412d-b8f1-7bdfc6d42970 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.519403 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13538473-796a-412d-b8f1-7bdfc6d42970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.521330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13538473-796a-412d-b8f1-7bdfc6d42970 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.542027 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1267/2544] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:45 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:45.546105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a49b45-3bfd-4d92-b957-267a185c9b6e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.556487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a49b45-3bfd-4d92-b957-267a185c9b6e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.561364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1da8-704d-4532-b038-b0fa03145d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.561995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1da8-704d-4532-b038-b0fa03145d6b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.562286 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1da8-704d-4532-b038-b0fa03145d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.562565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874a1da8-704d-4532-b038-b0fa03145d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.563216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a1da8-704d-4532-b038-b0fa03145d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.564857 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874a1da8-704d-4532-b038-b0fa03145d6b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.577500 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1278/2545] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:45.581154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13538473-796a-412d-b8f1-7bdfc6d42970 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.592260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13538473-796a-412d-b8f1-7bdfc6d42970 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.597020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865752f-82e6-4245-af50-9839024e569d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.597651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865752f-82e6-4245-af50-9839024e569d admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.597969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865752f-82e6-4245-af50-9839024e569d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.598249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0865752f-82e6-4245-af50-9839024e569d admin admin] PATH_INFO: `/v3/projects/05f6e1be41bf414fa9dc5519a3194423/users/88e2311eba45477b900f6a7ace95ecfa/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.613357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865752f-82e6-4245-af50-9839024e569d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f6e1be41bf414fa9dc5519a3194423, user_id=88e2311eba45477b900f6a7ace95ecfa, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.616107 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0865752f-82e6-4245-af50-9839024e569d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.629284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1268/2546] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:45 2022] PUT /identity/v3/projects/05f6e1be41bf414fa9dc5519a3194423/users/88e2311eba45477b900f6a7ace95ecfa/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:45.633228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1da8-704d-4532-b038-b0fa03145d6b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.644052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874a1da8-704d-4532-b038-b0fa03145d6b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.701129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a2f8e9-d6f8-46b3-9f11-affd49e2654c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.701655 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f8e9-d6f8-46b3-9f11-affd49e2654c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.701969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f8e9-d6f8-46b3-9f11-affd49e2654c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.702243 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a2f8e9-d6f8-46b3-9f11-affd49e2654c admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.702873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f8e9-d6f8-46b3-9f11-affd49e2654c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.704458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a2f8e9-d6f8-46b3-9f11-affd49e2654c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.714590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1279/2547] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:45.718670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865752f-82e6-4245-af50-9839024e569d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.729647 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0865752f-82e6-4245-af50-9839024e569d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.734355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.735035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.735321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.735624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] PATH_INFO: `/v3/projects/05f6e1be41bf414fa9dc5519a3194423/users/88e2311eba45477b900f6a7ace95ecfa/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.737562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f6e1be41bf414fa9dc5519a3194423, user_id=88e2311eba45477b900f6a7ace95ecfa, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.740257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.750401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1269/2548] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:45 2022] PUT /identity/v3/projects/05f6e1be41bf414fa9dc5519a3194423/users/88e2311eba45477b900f6a7ace95ecfa/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:45.760388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc2c9-9d1a-4fa1-b543-3fcdc7954960 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.760827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc2c9-9d1a-4fa1-b543-3fcdc7954960 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.761173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9bc2c9-9d1a-4fa1-b543-3fcdc7954960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.789625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4a9bc2c9-9d1a-4fa1-b543-3fcdc7954960 None None] MFA Rules not processed for user `88e2311eba45477b900f6a7ace95ecfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:45.790876 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a9bc2c9-9d1a-4fa1-b543-3fcdc7954960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:45.858018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1280/2549] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:45.868929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.870782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:45.928498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81652ad7-07f6-4151-9af6-f993ef5ec7c8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:45.932245 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1671aca-55fe-47f3-9045-3e33270d7546 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:45.932845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1671aca-55fe-47f3-9045-3e33270d7546 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:45.933127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1671aca-55fe-47f3-9045-3e33270d7546 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:45.933402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1671aca-55fe-47f3-9045-3e33270d7546 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:45.942276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1671aca-55fe-47f3-9045-3e33270d7546 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:45.943709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1671aca-55fe-47f3-9045-3e33270d7546 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:45.953090 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1270/2550] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:45.993536 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bc2c9-9d1a-4fa1-b543-3fcdc7954960 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:45.994997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4a9bc2c9-9d1a-4fa1-b543-3fcdc7954960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:46.001855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:46.008113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9bc2c9-9d1a-4fa1-b543-3fcdc7954960 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:46.011968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cdc1d4-b9f6-44dc-9fd2-fde86b88e3e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:46.012572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc1d4-b9f6-44dc-9fd2-fde86b88e3e6 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:46.012859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc1d4-b9f6-44dc-9fd2-fde86b88e3e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:46.013134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cdc1d4-b9f6-44dc-9fd2-fde86b88e3e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:46.069103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc1d4-b9f6-44dc-9fd2-fde86b88e3e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:46.070567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cdc1d4-b9f6-44dc-9fd2-fde86b88e3e6 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:46.080029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1281/2551] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:49.016434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1671aca-55fe-47f3-9045-3e33270d7546 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.083309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1671aca-55fe-47f3-9045-3e33270d7546 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.087888 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.089286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.089574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.089952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] PATH_INFO: `/v3/users/8a7cc7aaeed843e7a8dbba01178a8c0f` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.091179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a7cc7aaeed843e7a8dbba01178a8c0f)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.093101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.097952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.153122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a7cc7aaeed843e7a8dbba01178a8c0f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.154287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a7cc7aaeed843e7a8dbba01178a8c0f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.165202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a7cc7aaeed843e7a8dbba01178a8c0f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.175738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a7cc7aaeed843e7a8dbba01178a8c0f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.195823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a7cc7aaeed843e7a8dbba01178a8c0f'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.207798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1271/2552] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:49 2022] DELETE /identity/v3/users/8a7cc7aaeed843e7a8dbba01178a8c0f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:49.209835 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a59b-69f9-4d91-a89d-3dd0a38627ad None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.210333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a59b-69f9-4d91-a89d-3dd0a38627ad None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.210654 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee8a59b-69f9-4d91-a89d-3dd0a38627ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.244535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8ee8a59b-69f9-4d91-a89d-3dd0a38627ad None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:49.247245 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8ee8a59b-69f9-4d91-a89d-3dd0a38627ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:49.337428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1282/2553] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:49.349560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.351493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:49.417564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfa1a-2be7-42bc-8f75-350e7f9d5e96 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.421472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a15bd-bdcd-4521-a698-2b3316f18065 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.422133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a15bd-bdcd-4521-a698-2b3316f18065 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.422419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a15bd-bdcd-4521-a698-2b3316f18065 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.422692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a15bd-bdcd-4521-a698-2b3316f18065 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.433418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a15bd-bdcd-4521-a698-2b3316f18065 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.434902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a15bd-bdcd-4521-a698-2b3316f18065 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.444917 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1272/2554] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:49.733939 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8a59b-69f9-4d91-a89d-3dd0a38627ad None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.735441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8ee8a59b-69f9-4d91-a89d-3dd0a38627ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:49.750867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee8a59b-69f9-4d91-a89d-3dd0a38627ad None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.756176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.756371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.756726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.757063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] PATH_INFO: `/v3/projects/90a605d7eb02418f98ba42ce4fbdb550` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.758347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] RBAC: Authorizing `identity:delete_project(project_id=90a605d7eb02418f98ba42ce4fbdb550)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.760444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.808307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90a605d7eb02418f98ba42ce4fbdb550', 'request_id': 'req-40eb6abf-f9da-4611-b1ba-359ffdefe10b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.814615 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90a605d7eb02418f98ba42ce4fbdb550', 'request_id': 'req-40eb6abf-f9da-4611-b1ba-359ffdefe10b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.824069 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90a605d7eb02418f98ba42ce4fbdb550', 'request_id': 'req-40eb6abf-f9da-4611-b1ba-359ffdefe10b'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.834722 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] The token cache is being invalidate because project 90a605d7eb02418f98ba42ce4fbdb550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:49.835009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.835743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.837119 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1283/2555] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:49 2022] DELETE /identity/v3/projects/90a605d7eb02418f98ba42ce4fbdb550 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:49.842199 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a15bd-bdcd-4521-a698-2b3316f18065 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:49.852008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a15bd-bdcd-4521-a698-2b3316f18065 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:49.910124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:49.910753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:49.911037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:49.911316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] PATH_INFO: `/v3/users/190eff0c15274047a518ac821dbb2b8b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:49.912448 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=190eff0c15274047a518ac821dbb2b8b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:49.914427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:49.943770 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:49.964374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '190eff0c15274047a518ac821dbb2b8b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.965039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '190eff0c15274047a518ac821dbb2b8b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.972251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '190eff0c15274047a518ac821dbb2b8b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.979835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '190eff0c15274047a518ac821dbb2b8b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.992195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '190eff0c15274047a518ac821dbb2b8b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:49.998214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1273/2556] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:49 2022] DELETE /identity/v3/users/190eff0c15274047a518ac821dbb2b8b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:50.279642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:50.284448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:50.298340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6abf-f9da-4611-b1ba-359ffdefe10b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:50.320644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:50.366012 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:50.366810 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:50.367094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:50.367369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] PATH_INFO: `/v3/projects/b417238b441a4210851eb00896789549` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:50.368511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b417238b441a4210851eb00896789549)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:50.371025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:50.418902 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b417238b441a4210851eb00896789549', 'request_id': 'req-8eb61a95-2b94-45c6-ad91-a1317c92904a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.426422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b417238b441a4210851eb00896789549', 'request_id': 'req-8eb61a95-2b94-45c6-ad91-a1317c92904a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.438125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b417238b441a4210851eb00896789549', 'request_id': 'req-8eb61a95-2b94-45c6-ad91-a1317c92904a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.451979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] The token cache is being invalidate because project b417238b441a4210851eb00896789549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:50.452264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.452937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.455009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1284/2557] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:50 2022] DELETE /identity/v3/projects/b417238b441a4210851eb00896789549 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:50.459125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:50.460896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:50.477110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd1246-5a26-4840-b53a-f3d1b1779762 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:50.543721 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:50.544395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:50.544680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:50.544959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] PATH_INFO: `/v3/users/88e2311eba45477b900f6a7ace95ecfa` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:50.546155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=88e2311eba45477b900f6a7ace95ecfa)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:50.548097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:50.601323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88e2311eba45477b900f6a7ace95ecfa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.601999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88e2311eba45477b900f6a7ace95ecfa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.610239 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88e2311eba45477b900f6a7ace95ecfa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.617157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88e2311eba45477b900f6a7ace95ecfa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.629349 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2e7c949e-df77-4646-b941-8d6a86663dbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88e2311eba45477b900f6a7ace95ecfa'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:50.636007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1274/2558] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:50 2022] DELETE /identity/v3/users/88e2311eba45477b900f6a7ace95ecfa => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:50.937625 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:50.938895 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:50.953283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb61a95-2b94-45c6-ad91-a1317c92904a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:51.023294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:51.024088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.024446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.024794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] PATH_INFO: `/v3/projects/05f6e1be41bf414fa9dc5519a3194423` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.029435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f6e1be41bf414fa9dc5519a3194423)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:51.031489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:51.088614 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f6e1be41bf414fa9dc5519a3194423', 'request_id': 'req-23e37bf2-2d31-428c-9922-489a33679d83'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:51.095018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f6e1be41bf414fa9dc5519a3194423', 'request_id': 'req-23e37bf2-2d31-428c-9922-489a33679d83'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:51.097507 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:51.104130 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f6e1be41bf414fa9dc5519a3194423', 'request_id': 'req-23e37bf2-2d31-428c-9922-489a33679d83'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:51.116251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] The token cache is being invalidate because project 05f6e1be41bf414fa9dc5519a3194423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:51.116548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:51.117219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-23e37bf2-2d31-428c-9922-489a33679d83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:51.118745 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1285/2559] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:50 2022] DELETE /identity/v3/projects/05f6e1be41bf414fa9dc5519a3194423 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:51.126110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea42cb-44a3-485e-af2c-050c96e2ae80 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.126648 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea42cb-44a3-485e-af2c-050c96e2ae80 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.126998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efea42cb-44a3-485e-af2c-050c96e2ae80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.148015 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-efea42cb-44a3-485e-af2c-050c96e2ae80 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:51.149279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-efea42cb-44a3-485e-af2c-050c96e2ae80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:51.169293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:51.216800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1275/2560] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:51.225528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4be09-1f66-43c7-9dcf-00e1b47b681a None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.225815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4be09-1f66-43c7-9dcf-00e1b47b681a None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.226122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c4be09-1f66-43c7-9dcf-00e1b47b681a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.246371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-17c4be09-1f66-43c7-9dcf-00e1b47b681a None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:51.247595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-17c4be09-1f66-43c7-9dcf-00e1b47b681a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:51.255790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1286/2561] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:51.260554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea42cb-44a3-485e-af2c-050c96e2ae80 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:51.270704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efea42cb-44a3-485e-af2c-050c96e2ae80 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:51.275355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:51.276109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.276415 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.276711 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.277398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:51.277709 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:51.279377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:51.292224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1276/2562] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:51.296591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4be09-1f66-43c7-9dcf-00e1b47b681a None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:51.305778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c4be09-1f66-43c7-9dcf-00e1b47b681a None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:51.311321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c3913-5cec-4107-a816-63006409ba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:51.311954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c3913-5cec-4107-a816-63006409ba4e admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.312275 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c3913-5cec-4107-a816-63006409ba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.312550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c3913-5cec-4107-a816-63006409ba4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.313212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c3913-5cec-4107-a816-63006409ba4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:51.315115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c3913-5cec-4107-a816-63006409ba4e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:51.343994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1287/2563] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:51 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:44:51.347999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:51.359988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60c0e-6421-404e-802b-5d2d1d4d6bf1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:51.422631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e3ed-7f9a-44e4-a00a-a85b83542751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:51.423234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e3ed-7f9a-44e4-a00a-a85b83542751 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.423516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e3ed-7f9a-44e4-a00a-a85b83542751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.423789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b1e3ed-7f9a-44e4-a00a-a85b83542751 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.424401 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1e3ed-7f9a-44e4-a00a-a85b83542751 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:51.426357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b1e3ed-7f9a-44e4-a00a-a85b83542751 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:51.447690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1277/2564] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:51 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:51.451999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c3913-5cec-4107-a816-63006409ba4e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:51.462717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c3913-5cec-4107-a816-63006409ba4e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:51.468216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2dbc6-29d5-4269-aefc-6895b59fcc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:51.468927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2dbc6-29d5-4269-aefc-6895b59fcc0f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.469212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2dbc6-29d5-4269-aefc-6895b59fcc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.469516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab2dbc6-29d5-4269-aefc-6895b59fcc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.470338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2dbc6-29d5-4269-aefc-6895b59fcc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:51.471811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab2dbc6-29d5-4269-aefc-6895b59fcc0f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:51.483952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1288/2565] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:44:51.488161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e3ed-7f9a-44e4-a00a-a85b83542751 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:51.499710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b1e3ed-7f9a-44e4-a00a-a85b83542751 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:51.504398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7c0b1-ff60-4ddc-a606-0ddd6b8e96fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:51.504999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7c0b1-ff60-4ddc-a606-0ddd6b8e96fd admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.505289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7c0b1-ff60-4ddc-a606-0ddd6b8e96fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.505568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7c0b1-ff60-4ddc-a606-0ddd6b8e96fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.506258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7c0b1-ff60-4ddc-a606-0ddd6b8e96fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:51.507867 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7c0b1-ff60-4ddc-a606-0ddd6b8e96fd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:51.518605 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1278/2566] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:51.522855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2dbc6-29d5-4269-aefc-6895b59fcc0f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:51.533287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab2dbc6-29d5-4269-aefc-6895b59fcc0f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:51.537868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:51.538552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.538837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.539111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] PATH_INFO: `/v3/projects/6e2ff31fef434f5fbfddde5029a2a0ff/users/eeefb0ed8b404d0ebe04b306fa2ab5d9/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.554502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2ff31fef434f5fbfddde5029a2a0ff, user_id=eeefb0ed8b404d0ebe04b306fa2ab5d9, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:51.557786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:51.570985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1289/2567] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:51 2022] PUT /identity/v3/projects/6e2ff31fef434f5fbfddde5029a2a0ff/users/eeefb0ed8b404d0ebe04b306fa2ab5d9/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:51.583887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f16f1-8862-48ac-a468-384fb4e03891 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.584179 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f16f1-8862-48ac-a468-384fb4e03891 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.584456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f16f1-8862-48ac-a468-384fb4e03891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.612539 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-923f16f1-8862-48ac-a468-384fb4e03891 None None] MFA Rules not processed for user `eeefb0ed8b404d0ebe04b306fa2ab5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:51.613746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-923f16f1-8862-48ac-a468-384fb4e03891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:51.676413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1279/2568] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:51.688555 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:51.690375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:51.748186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be67f5-9f54-483c-b210-f22f9b461c40 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:51.751848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:51.752548 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:51.752720 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:51.753001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:51.761716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:51.763192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:51.772394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1290/2569] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:52.206173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f16f1-8862-48ac-a468-384fb4e03891 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:52.216613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f16f1-8862-48ac-a468-384fb4e03891 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:52.220198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:52.220815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:52.221095 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:52.221372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:52.223087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:52.240434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:52.283959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:52.285345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:52.294431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1280/2570] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:54.727515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:54.728981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:54.787898 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6bf991-6989-4c95-ac5a-44071430f15b service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:54.791827 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce197e8e-8021-496c-84b1-bb234d0bb896 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:54.792434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce197e8e-8021-496c-84b1-bb234d0bb896 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:54.792717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce197e8e-8021-496c-84b1-bb234d0bb896 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:54.792993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce197e8e-8021-496c-84b1-bb234d0bb896 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:54.794739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ce197e8e-8021-496c-84b1-bb234d0bb896 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:54.835868 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:54.862650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce197e8e-8021-496c-84b1-bb234d0bb896 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:54.864204 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce197e8e-8021-496c-84b1-bb234d0bb896 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:54.878008 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1291/2571] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:57.291929 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.307964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e5b1f-1b81-47d8-b691-7deeaf23c30e service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.314041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.314754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.315170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.315603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] PATH_INFO: `/v3/users/eeefb0ed8b404d0ebe04b306fa2ab5d9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.316927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeefb0ed8b404d0ebe04b306fa2ab5d9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:57.319375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:57.394939 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeefb0ed8b404d0ebe04b306fa2ab5d9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:57.395767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeefb0ed8b404d0ebe04b306fa2ab5d9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:57.409252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeefb0ed8b404d0ebe04b306fa2ab5d9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:57.419686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeefb0ed8b404d0ebe04b306fa2ab5d9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:57.435799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeefb0ed8b404d0ebe04b306fa2ab5d9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:57.441940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1281/2572] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:57 2022] DELETE /identity/v3/users/eeefb0ed8b404d0ebe04b306fa2ab5d9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:57.447583 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8049a2-e66f-4536-983d-5dcbf5b07416 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.448187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8049a2-e66f-4536-983d-5dcbf5b07416 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.448569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8049a2-e66f-4536-983d-5dcbf5b07416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.469811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1e8049a2-e66f-4536-983d-5dcbf5b07416 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:57.471127 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1e8049a2-e66f-4536-983d-5dcbf5b07416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:57.546002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1292/2573] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:57.554028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.559480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:57.618190 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae10d2-c485-4165-8ff5-9669d5b8c9b7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:57.622641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b675f6d-cc86-467c-80ce-82ec5ff9df74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:57.627729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b675f6d-cc86-467c-80ce-82ec5ff9df74 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:57.628138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b675f6d-cc86-467c-80ce-82ec5ff9df74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:57.628513 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b675f6d-cc86-467c-80ce-82ec5ff9df74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:57.643085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b675f6d-cc86-467c-80ce-82ec5ff9df74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:57.644870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b675f6d-cc86-467c-80ce-82ec5ff9df74 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:57.660828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1282/2574] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:57.979593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8049a2-e66f-4536-983d-5dcbf5b07416 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:57.981315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1e8049a2-e66f-4536-983d-5dcbf5b07416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:58.016309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8049a2-e66f-4536-983d-5dcbf5b07416 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.037780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.038626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.039167 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.039449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] PATH_INFO: `/v3/projects/6e2ff31fef434f5fbfddde5029a2a0ff` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.041320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2ff31fef434f5fbfddde5029a2a0ff)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.043568 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.146398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2ff31fef434f5fbfddde5029a2a0ff', 'request_id': 'req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:58.156538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2ff31fef434f5fbfddde5029a2a0ff', 'request_id': 'req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:58.171962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2ff31fef434f5fbfddde5029a2a0ff', 'request_id': 'req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:58.190758 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] The token cache is being invalidate because project 6e2ff31fef434f5fbfddde5029a2a0ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:44:58.191318 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:58.192176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-00b37d6e-1f28-4dea-b6ba-133a79f5e6a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:58.194553 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1293/2575] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:44:57 2022] DELETE /identity/v3/projects/6e2ff31fef434f5fbfddde5029a2a0ff => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:44:58.199324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f815fa5-940d-4e69-82de-b084705c2fd6 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.200023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f815fa5-940d-4e69-82de-b084705c2fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.201702 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f815fa5-940d-4e69-82de-b084705c2fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.232290 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-7f815fa5-940d-4e69-82de-b084705c2fd6 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:58.233637 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7f815fa5-940d-4e69-82de-b084705c2fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:58.271383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:58.316145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1283/2576] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:58.319169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5d84-73ab-4bb2-a512-4d5c15542e1e None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.319592 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5d84-73ab-4bb2-a512-4d5c15542e1e None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.319963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f5d84-73ab-4bb2-a512-4d5c15542e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.389037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-117f5d84-73ab-4bb2-a512-4d5c15542e1e None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:58.391113 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-117f5d84-73ab-4bb2-a512-4d5c15542e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:58.402000 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1294/2577] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:58.405785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f815fa5-940d-4e69-82de-b084705c2fd6 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.420483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f815fa5-940d-4e69-82de-b084705c2fd6 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.425916 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.427506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.427902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.428295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.429106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:44:58.429595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.432901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.458955 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1284/2578] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:44:58.466854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f5d84-73ab-4bb2-a512-4d5c15542e1e None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.496225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f5d84-73ab-4bb2-a512-4d5c15542e1e None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.505253 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51cdc2-0db4-4700-a58b-100e9442e5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.506891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cdc2-0db4-4700-a58b-100e9442e5b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.508074 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cdc2-0db4-4700-a58b-100e9442e5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.508397 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cdc2-0db4-4700-a58b-100e9442e5b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.509270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51cdc2-0db4-4700-a58b-100e9442e5b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.513279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51cdc2-0db4-4700-a58b-100e9442e5b4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.584431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1295/2579] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:44:58 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:58.590508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.621268 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd933d-f300-488e-bdf2-ce554b3cbeec admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.790425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564525f-6c0f-4153-8567-0b17ff8b7f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.792321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564525f-6c0f-4153-8567-0b17ff8b7f8c admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.792624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564525f-6c0f-4153-8567-0b17ff8b7f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.792907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0564525f-6c0f-4153-8567-0b17ff8b7f8c admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.793714 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564525f-6c0f-4153-8567-0b17ff8b7f8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.797285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0564525f-6c0f-4153-8567-0b17ff8b7f8c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.874115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51cdc2-0db4-4700-a58b-100e9442e5b4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.885275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1285/2580] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:44:58 2022] POST /identity/v3/users => generated 287 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:44:58.888081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51cdc2-0db4-4700-a58b-100e9442e5b4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.899220 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a6506-1221-4d4a-a850-0cc5a77a7385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.900566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a6506-1221-4d4a-a850-0cc5a77a7385 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.901422 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a6506-1221-4d4a-a850-0cc5a77a7385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.901700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a6506-1221-4d4a-a850-0cc5a77a7385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.902404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a6506-1221-4d4a-a850-0cc5a77a7385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.904030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a6506-1221-4d4a-a850-0cc5a77a7385 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:58.932790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1296/2581] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:58.937907 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564525f-6c0f-4153-8567-0b17ff8b7f8c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:58.972387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917d12-f102-45d6-a1ca-8e04857d9c02 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.972688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917d12-f102-45d6-a1ca-8e04857d9c02 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.973185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1917d12-f102-45d6-a1ca-8e04857d9c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.975092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0564525f-6c0f-4153-8567-0b17ff8b7f8c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:58.981978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd6918-afff-4b8c-b1f0-45d82d06abed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:58.982686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd6918-afff-4b8c-b1f0-45d82d06abed admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:58.983413 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd6918-afff-4b8c-b1f0-45d82d06abed admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:58.983697 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd6918-afff-4b8c-b1f0-45d82d06abed admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:58.984688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd6918-afff-4b8c-b1f0-45d82d06abed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:58.986833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd6918-afff-4b8c-b1f0-45d82d06abed admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.010553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1286/2582] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:44:59.011016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d1917d12-f102-45d6-a1ca-8e04857d9c02 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:59.012271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d1917d12-f102-45d6-a1ca-8e04857d9c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:59.013983 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd6918-afff-4b8c-b1f0-45d82d06abed admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.028364 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd6918-afff-4b8c-b1f0-45d82d06abed admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.035937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8fe550-148f-4e51-97f2-fe411da86d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.037126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.055786 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe550-148f-4e51-97f2-fe411da86d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.056316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe550-148f-4e51-97f2-fe411da86d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.057214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8fe550-148f-4e51-97f2-fe411da86d98 admin admin] PATH_INFO: `/v3/projects/947a9baf001d47f3baf57932af043143/users/21295fabeb1349a7a21d602fcbdbdf0a/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.082400 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fe550-148f-4e51-97f2-fe411da86d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=947a9baf001d47f3baf57932af043143, user_id=21295fabeb1349a7a21d602fcbdbdf0a, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.085964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8fe550-148f-4e51-97f2-fe411da86d98 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.115546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1287/2583] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:44:59 2022] PUT /identity/v3/projects/947a9baf001d47f3baf57932af043143/users/21295fabeb1349a7a21d602fcbdbdf0a/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:44:59.121357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4081b-301e-4690-95a2-1164fb0c6d1c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.122332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4081b-301e-4690-95a2-1164fb0c6d1c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.122897 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4081b-301e-4690-95a2-1164fb0c6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.131826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1297/2584] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:44:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:44:59.146832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917d12-f102-45d6-a1ca-8e04857d9c02 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.157865 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d1917d12-f102-45d6-a1ca-8e04857d9c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:59.166990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bdf4081b-301e-4690-95a2-1164fb0c6d1c None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:44:59.173093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bdf4081b-301e-4690-95a2-1164fb0c6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:59.298846 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1288/2585] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:44:59.323299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4081b-301e-4690-95a2-1164fb0c6d1c None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.324775 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bdf4081b-301e-4690-95a2-1164fb0c6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:59.376921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.392983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1917d12-f102-45d6-a1ca-8e04857d9c02 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.499187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4081b-301e-4690-95a2-1164fb0c6d1c None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.503311 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.504035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.504393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.504743 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.519493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.521292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.521802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.522262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.522966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.524300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.541288 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1289/2586] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:44:59.545465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.549540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:59.637851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.640129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.664837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1298/2587] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:44:59.666968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:44:59.668679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:59.709392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a75b51d-dda1-4238-9b7b-2888a05bdd50 service swift] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.720380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728c32d-6a43-47d0-a9eb-7a8137a8d19f service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:44:59.727719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.729729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.741995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.744594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] PATH_INFO: `/v3/users/e1382292b43945b4871382306f36772a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.744998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:44:59.745975 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:44:59.747740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1382292b43945b4871382306f36772a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.748139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:44:59.751016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:44:59.755857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:44:59.757364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.763368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:44:59.803205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:44:59.814134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:44:59.844652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1290/2588] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:44:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:44:59.892376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1382292b43945b4871382306f36772a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:59.923037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1382292b43945b4871382306f36772a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:59.924854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1382292b43945b4871382306f36772a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:59.943874 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1382292b43945b4871382306f36772a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:59.973109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1382292b43945b4871382306f36772a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:44:59.989428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1299/2589] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:44:59 2022] DELETE /identity/v3/users/e1382292b43945b4871382306f36772a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:00.354900 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.356650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:00.375375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356afac8-8e0b-4ef0-a0e1-7d1aedee9c72 service nova] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.453021 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:00.454645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:00.542752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67353005-1191-4219-80ef-06853d655222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.543396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67353005-1191-4219-80ef-06853d655222 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.543675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67353005-1191-4219-80ef-06853d655222 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.543948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67353005-1191-4219-80ef-06853d655222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.546470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-67353005-1191-4219-80ef-06853d655222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:00.566391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26035ea9-7af8-4fb2-bd7c-5ea72d3c3a56 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:00.574460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:00.578342 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.578919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.579437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] PATH_INFO: `/v3/projects/4b514585751f4c1fac64196cdb1847e9` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.580937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b514585751f4c1fac64196cdb1847e9)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.583455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.616857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:00.645691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67353005-1191-4219-80ef-06853d655222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:00.647462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67353005-1191-4219-80ef-06853d655222 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:00.695199 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1291/2590] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:00.740003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596842-6d09-4967-953d-5ee0ed5cb9d1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.740267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596842-6d09-4967-953d-5ee0ed5cb9d1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.740554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596842-6d09-4967-953d-5ee0ed5cb9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.749714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b514585751f4c1fac64196cdb1847e9', 'request_id': 'req-2428e3b3-4361-4299-901e-ac40d0624400'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:00.758177 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b514585751f4c1fac64196cdb1847e9', 'request_id': 'req-2428e3b3-4361-4299-901e-ac40d0624400'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:00.769214 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b514585751f4c1fac64196cdb1847e9', 'request_id': 'req-2428e3b3-4361-4299-901e-ac40d0624400'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:00.816295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] The token cache is being invalidate because project 4b514585751f4c1fac64196cdb1847e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:00.816596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:00.825265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2428e3b3-4361-4299-901e-ac40d0624400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:00.833148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f2596842-6d09-4967-953d-5ee0ed5cb9d1 None None] MFA Rules not processed for user `21295fabeb1349a7a21d602fcbdbdf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:00.834233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f2596842-6d09-4967-953d-5ee0ed5cb9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:00.842072 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1300/2591] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:00 2022] DELETE /identity/v3/projects/4b514585751f4c1fac64196cdb1847e9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:00.846999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce74901-2dae-47c1-a70c-fb0fdbbe0d20 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:00.849024 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce74901-2dae-47c1-a70c-fb0fdbbe0d20 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:00.849326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce74901-2dae-47c1-a70c-fb0fdbbe0d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:00.912672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bce74901-2dae-47c1-a70c-fb0fdbbe0d20 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:00.924288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bce74901-2dae-47c1-a70c-fb0fdbbe0d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:00.937730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.005081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1292/2592] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:01.014684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596842-6d09-4967-953d-5ee0ed5cb9d1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.018725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f2596842-6d09-4967-953d-5ee0ed5cb9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:01.142658 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1301/2593] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:01.158067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990be2b8-f9fd-4e2b-8960-9dff5265b37b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.158067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990be2b8-f9fd-4e2b-8960-9dff5265b37b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.158067 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990be2b8-f9fd-4e2b-8960-9dff5265b37b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.218445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-990be2b8-f9fd-4e2b-8960-9dff5265b37b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:01.219681 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-990be2b8-f9fd-4e2b-8960-9dff5265b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:01.221516 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596842-6d09-4967-953d-5ee0ed5cb9d1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.226116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29068f-a374-4717-900c-455b6ea49739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.226949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29068f-a374-4717-900c-455b6ea49739 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.227449 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29068f-a374-4717-900c-455b6ea49739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.230967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1302/2594] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:01.230967 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990be2b8-f9fd-4e2b-8960-9dff5265b37b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.231205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29068f-a374-4717-900c-455b6ea49739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.231288 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-990be2b8-f9fd-4e2b-8960-9dff5265b37b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:01.243880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29068f-a374-4717-900c-455b6ea49739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.245627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29068f-a374-4717-900c-455b6ea49739 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.256009 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1293/2595] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:45:01.256865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29068f-a374-4717-900c-455b6ea49739 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.268750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29068f-a374-4717-900c-455b6ea49739 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.273981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.274517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.275447 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.275904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.276974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:01.277092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.278704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.294036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990be2b8-f9fd-4e2b-8960-9dff5265b37b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.295688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1294/2596] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:01.296559 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.298446 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.299160 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.299557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.299930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.301793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:01.307800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f2e02-13a6-4243-9c01-e8fecb3abb14 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.315349 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.317090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.324442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeaf42-a46b-4673-b815-12e06561a172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.325075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeaf42-a46b-4673-b815-12e06561a172 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.325360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeaf42-a46b-4673-b815-12e06561a172 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.325636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebeaf42-a46b-4673-b815-12e06561a172 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.327565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeaf42-a46b-4673-b815-12e06561a172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.328911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1303/2597] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:01.330391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebeaf42-a46b-4673-b815-12e06561a172 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.398978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1295/2598] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:01 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:01.403591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.423648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941efa99-4c5b-4d76-a2b7-90e4b7b15f4d service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.545208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b6e8-64b8-4ac1-a6a4-c6f85c2e84ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.546020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b6e8-64b8-4ac1-a6a4-c6f85c2e84ee admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.546375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b6e8-64b8-4ac1-a6a4-c6f85c2e84ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.546727 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b481b6e8-64b8-4ac1-a6a4-c6f85c2e84ee admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.547470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481b6e8-64b8-4ac1-a6a4-c6f85c2e84ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.549710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b481b6e8-64b8-4ac1-a6a4-c6f85c2e84ee admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.599403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1304/2599] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:01 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:45:01.604462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeaf42-a46b-4673-b815-12e06561a172 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.616497 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebeaf42-a46b-4673-b815-12e06561a172 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.622097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abcc06-9bd4-4de7-836a-a45f2de23dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.622793 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcc06-9bd4-4de7-836a-a45f2de23dcd admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.623147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcc06-9bd4-4de7-836a-a45f2de23dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.623590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcc06-9bd4-4de7-836a-a45f2de23dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.624848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abcc06-9bd4-4de7-836a-a45f2de23dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.626733 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abcc06-9bd4-4de7-836a-a45f2de23dcd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.661417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b6e8-64b8-4ac1-a6a4-c6f85c2e84ee admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.677892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b481b6e8-64b8-4ac1-a6a4-c6f85c2e84ee admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.682185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1296/2600] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:01.687464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68567c43-4714-4ebd-ad56-81b329564384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.688085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68567c43-4714-4ebd-ad56-81b329564384 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.688394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68567c43-4714-4ebd-ad56-81b329564384 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.688639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68567c43-4714-4ebd-ad56-81b329564384 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.689345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68567c43-4714-4ebd-ad56-81b329564384 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.691194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68567c43-4714-4ebd-ad56-81b329564384 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.708145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1305/2601] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:01.712089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abcc06-9bd4-4de7-836a-a45f2de23dcd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.727184 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abcc06-9bd4-4de7-836a-a45f2de23dcd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:01.737538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:01.740362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.740969 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.741469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] PATH_INFO: `/v3/projects/9edb650ef1c449dd8ea38ed8a08dedb2/users/6ec09725938c4901be8b4f37db151a38/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.777429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9edb650ef1c449dd8ea38ed8a08dedb2, user_id=6ec09725938c4901be8b4f37db151a38, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:01.787849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:01.822126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1297/2602] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:01 2022] PUT /identity/v3/projects/9edb650ef1c449dd8ea38ed8a08dedb2/users/6ec09725938c4901be8b4f37db151a38/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:45:01.830626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167fad-d450-45c2-b637-5afeb9bcdf50 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:01.830917 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167fad-d450-45c2-b637-5afeb9bcdf50 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:01.831198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad167fad-d450-45c2-b637-5afeb9bcdf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:01.863032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ad167fad-d450-45c2-b637-5afeb9bcdf50 None None] MFA Rules not processed for user `6ec09725938c4901be8b4f37db151a38`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:01.864430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ad167fad-d450-45c2-b637-5afeb9bcdf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:01.878682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:01.946597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1306/2603] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:01.958683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:01.960419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:01.969404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:02.086923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6d5636-3c53-4687-82ce-d6dc8790e137 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:02.095598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea136c-ffe2-4c0c-8725-2109fa4c8589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:02.096753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea136c-ffe2-4c0c-8725-2109fa4c8589 service nova] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.097295 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea136c-ffe2-4c0c-8725-2109fa4c8589 service nova] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.097974 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea136c-ffe2-4c0c-8725-2109fa4c8589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.110024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea136c-ffe2-4c0c-8725-2109fa4c8589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:02.112754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea136c-ffe2-4c0c-8725-2109fa4c8589 service nova] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:02.128348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1298/2604] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:02.455458 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167fad-d450-45c2-b637-5afeb9bcdf50 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:02.559991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad167fad-d450-45c2-b637-5afeb9bcdf50 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:02.569649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:02.570348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.570636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.570918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] PATH_INFO: `/v3/users/6ec09725938c4901be8b4f37db151a38` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.573770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec09725938c4901be8b4f37db151a38)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:02.576060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:02.674227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec09725938c4901be8b4f37db151a38'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:02.696091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec09725938c4901be8b4f37db151a38'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:02.699390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec09725938c4901be8b4f37db151a38'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:02.715048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec09725938c4901be8b4f37db151a38'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:02.729912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fdee95e7-e89e-48e0-b73a-29789782e7b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec09725938c4901be8b4f37db151a38'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:02.740264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1307/2605] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:02 2022] DELETE /identity/v3/users/6ec09725938c4901be8b4f37db151a38 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:02.742165 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118884-6eff-4535-8bab-c9228b956290 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.743083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118884-6eff-4535-8bab-c9228b956290 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.744282 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4118884-6eff-4535-8bab-c9228b956290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.781609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-b4118884-6eff-4535-8bab-c9228b956290 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:02.783499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b4118884-6eff-4535-8bab-c9228b956290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:02.843901 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933fb2-cdeb-4d9f-893f-d5a045a3d5bb None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:02.844457 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933fb2-cdeb-4d9f-893f-d5a045a3d5bb None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:02.844909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90933fb2-cdeb-4d9f-893f-d5a045a3d5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:02.866919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-90933fb2-cdeb-4d9f-893f-d5a045a3d5bb None None] MFA Rules not processed for user `21295fabeb1349a7a21d602fcbdbdf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:02.868469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-90933fb2-cdeb-4d9f-893f-d5a045a3d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:02.898451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1299/2606] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:02.909540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118884-6eff-4535-8bab-c9228b956290 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:02.910608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:02.911369 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-b4118884-6eff-4535-8bab-c9228b956290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:02.961132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1308/2607] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:45:03.033192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4118884-6eff-4535-8bab-c9228b956290 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:03.044102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:03.045067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.045530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.046149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.066769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:03.069825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:03.111810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1300/2608] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:45:03.392662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90933fb2-cdeb-4d9f-893f-d5a045a3d5bb None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:03.407638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90933fb2-cdeb-4d9f-893f-d5a045a3d5bb None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:03.419428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806128b2-ce8a-49fd-907d-263cf3118120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:03.420478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806128b2-ce8a-49fd-907d-263cf3118120 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:03.420909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806128b2-ce8a-49fd-907d-263cf3118120 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:03.421352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806128b2-ce8a-49fd-907d-263cf3118120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:03.423777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-806128b2-ce8a-49fd-907d-263cf3118120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:03.438612 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806128b2-ce8a-49fd-907d-263cf3118120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:03.442257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806128b2-ce8a-49fd-907d-263cf3118120 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:03.476449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1309/2609] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:45:04.008058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.009788 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:04.031710 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd564f-3dcf-4e6e-b805-9df9a45ed309 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.055068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.058070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.058070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.058070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] PATH_INFO: `/v3/projects/9edb650ef1c449dd8ea38ed8a08dedb2` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.060558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9edb650ef1c449dd8ea38ed8a08dedb2)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.062589 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.137125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:04.178153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9edb650ef1c449dd8ea38ed8a08dedb2', 'request_id': 'req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:04.191794 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9edb650ef1c449dd8ea38ed8a08dedb2', 'request_id': 'req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:04.210967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9edb650ef1c449dd8ea38ed8a08dedb2', 'request_id': 'req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:04.225799 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] The token cache is being invalidate because project 9edb650ef1c449dd8ea38ed8a08dedb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:04.226321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:04.227791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:04.229557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1301/2610] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:04 2022] DELETE /identity/v3/projects/9edb650ef1c449dd8ea38ed8a08dedb2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:04.235198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0d437-e158-46e2-8820-686e2580d82d None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.235936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0d437-e158-46e2-8820-686e2580d82d None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.235936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e0d437-e158-46e2-8820-686e2580d82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.274284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-a0e0d437-e158-46e2-8820-686e2580d82d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:04.276597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-a0e0d437-e158-46e2-8820-686e2580d82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:04.287541 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.289395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:04.394867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1310/2611] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:04.394867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a97ec-8813-460f-abc0-9afc470d3f42 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.394867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a97ec-8813-460f-abc0-9afc470d3f42 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.394867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a97ec-8813-460f-abc0-9afc470d3f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.425713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9e2a97ec-8813-460f-abc0-9afc470d3f42 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:04.427594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9e2a97ec-8813-460f-abc0-9afc470d3f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:04.441171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1311/2612] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:04.445405 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a97ec-8813-460f-abc0-9afc470d3f42 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.452110 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c406f3e7-f96f-41f1-a68c-ff5563b1ca39 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.460238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.460904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.461193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.461613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.463963 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:04.471299 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a97ec-8813-460f-abc0-9afc470d3f42 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.485073 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.485713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.486039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.486698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.487404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:04.487721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.489767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.491727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.494682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.504297 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1302/2613] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:04.567274 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1312/2614] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:45:04.567772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.580795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1c4c1-3d11-4273-ab7f-1b36a9f1416d service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.586760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056069-11ef-42b0-81df-769597d5de70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.588480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056069-11ef-42b0-81df-769597d5de70 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.588887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056069-11ef-42b0-81df-769597d5de70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.589267 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf056069-11ef-42b0-81df-769597d5de70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.590870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf056069-11ef-42b0-81df-769597d5de70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.592254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf056069-11ef-42b0-81df-769597d5de70 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.676283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1303/2615] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:04 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:45:04.677921 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.700627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba48311-7535-4bd7-97ba-1721f2ed3cbf admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.849512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e636ca3-1478-42c3-b10b-1ab123e2f1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.850165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e636ca3-1478-42c3-b10b-1ab123e2f1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.850448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e636ca3-1478-42c3-b10b-1ab123e2f1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.850909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e636ca3-1478-42c3-b10b-1ab123e2f1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.851554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e636ca3-1478-42c3-b10b-1ab123e2f1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.853546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e636ca3-1478-42c3-b10b-1ab123e2f1f6 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.898365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056069-11ef-42b0-81df-769597d5de70 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.911832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1313/2616] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:04 2022] POST /identity/v3/users => generated 291 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:04.916731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf056069-11ef-42b0-81df-769597d5de70 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.929309 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a4b64-b2b6-4031-bef1-b17bec5ae36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.930326 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4b64-b2b6-4031-bef1-b17bec5ae36e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.930686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4b64-b2b6-4031-bef1-b17bec5ae36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.932059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4b64-b2b6-4031-bef1-b17bec5ae36e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.932839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a4b64-b2b6-4031-bef1-b17bec5ae36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.936062 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a4b64-b2b6-4031-bef1-b17bec5ae36e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:04.949823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1304/2617] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:04.953948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e636ca3-1478-42c3-b10b-1ab123e2f1f6 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:04.971574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e636ca3-1478-42c3-b10b-1ab123e2f1f6 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:04.980339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63b8f-bd67-4163-9d02-7f565def9bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:04.980757 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63b8f-bd67-4163-9d02-7f565def9bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:04.981150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63b8f-bd67-4163-9d02-7f565def9bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:04.981294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63b8f-bd67-4163-9d02-7f565def9bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:04.982362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f63b8f-bd67-4163-9d02-7f565def9bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:04.983635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f63b8f-bd67-4163-9d02-7f565def9bfb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.011503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1314/2618] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:05.018006 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a4b64-b2b6-4031-bef1-b17bec5ae36e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.031727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a4b64-b2b6-4031-bef1-b17bec5ae36e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.044483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e307d-3df5-4d6f-95f3-a42a7621ea53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.048234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e307d-3df5-4d6f-95f3-a42a7621ea53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.048645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e307d-3df5-4d6f-95f3-a42a7621ea53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.049029 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e307d-3df5-4d6f-95f3-a42a7621ea53 admin admin] PATH_INFO: `/v3/projects/1d5bb88574324c03ba4c7def3dbd5100/users/e681bb85707f4347878bc30cd47e64c6/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.088133 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e307d-3df5-4d6f-95f3-a42a7621ea53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d5bb88574324c03ba4c7def3dbd5100, user_id=e681bb85707f4347878bc30cd47e64c6, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.098068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e307d-3df5-4d6f-95f3-a42a7621ea53 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.138429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5caf-9e49-4c79-b8ea-7af63152d6c6 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.138638 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1305/2619] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:05 2022] PUT /identity/v3/projects/1d5bb88574324c03ba4c7def3dbd5100/users/e681bb85707f4347878bc30cd47e64c6/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:05.138754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5caf-9e49-4c79-b8ea-7af63152d6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.138987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5caf-9e49-4c79-b8ea-7af63152d6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.174743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ac3c5caf-9e49-4c79-b8ea-7af63152d6c6 None None] MFA Rules not processed for user `e681bb85707f4347878bc30cd47e64c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:05.176294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ac3c5caf-9e49-4c79-b8ea-7af63152d6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:05.198851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.295952 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1315/2620] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:05.301533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e307d-3df5-4d6f-95f3-a42a7621ea53 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.414908 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:05.447852 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e307d-3df5-4d6f-95f3-a42a7621ea53 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.457266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616cb05-6f26-4cd2-b638-b36b4d769687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.458472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616cb05-6f26-4cd2-b638-b36b4d769687 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.458602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616cb05-6f26-4cd2-b638-b36b4d769687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.458973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f616cb05-6f26-4cd2-b638-b36b4d769687 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.459726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616cb05-6f26-4cd2-b638-b36b4d769687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.469576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f616cb05-6f26-4cd2-b638-b36b4d769687 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.525241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1306/2621] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:05 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:05.529001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5caf-9e49-4c79-b8ea-7af63152d6c6 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.545702 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5caf-9e49-4c79-b8ea-7af63152d6c6 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.689991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5f8e-9a57-49db-afab-ea03a1b724b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.691251 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5f8e-9a57-49db-afab-ea03a1b724b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.691538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5f8e-9a57-49db-afab-ea03a1b724b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.691951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e5f8e-9a57-49db-afab-ea03a1b724b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.693118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e5f8e-9a57-49db-afab-ea03a1b724b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.696036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e5f8e-9a57-49db-afab-ea03a1b724b9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.783030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616cb05-6f26-4cd2-b638-b36b4d769687 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.793444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1316/2622] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:05 2022] POST /identity/v3/users => generated 295 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:05.799344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f616cb05-6f26-4cd2-b638-b36b4d769687 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.808674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385f59-3ad7-4755-9a86-3341135b1ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.809462 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385f59-3ad7-4755-9a86-3341135b1ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.809840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385f59-3ad7-4755-9a86-3341135b1ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.817158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5385f59-3ad7-4755-9a86-3341135b1ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.817158 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385f59-3ad7-4755-9a86-3341135b1ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.818292 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5385f59-3ad7-4755-9a86-3341135b1ef8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.841713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1307/2623] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:05.843031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5f8e-9a57-49db-afab-ea03a1b724b9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.860531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e5f8e-9a57-49db-afab-ea03a1b724b9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:05.878175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f1b1-9096-44b6-abcc-60561e249f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:05.878858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f1b1-9096-44b6-abcc-60561e249f89 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:05.879146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f1b1-9096-44b6-abcc-60561e249f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:05.879420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f1b1-9096-44b6-abcc-60561e249f89 admin admin] PATH_INFO: `/v3/projects/29bfc653e4b0460b8e4296e161d85343/users/e8eb2eadb78d458c8e2acfef2cd88fb3/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:05.922607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8f1b1-9096-44b6-abcc-60561e249f89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bfc653e4b0460b8e4296e161d85343, user_id=e8eb2eadb78d458c8e2acfef2cd88fb3, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:05.925772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8f1b1-9096-44b6-abcc-60561e249f89 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:05.953120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1317/2624] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:05 2022] PUT /identity/v3/projects/29bfc653e4b0460b8e4296e161d85343/users/e8eb2eadb78d458c8e2acfef2cd88fb3/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:05.957307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385f59-3ad7-4755-9a86-3341135b1ef8 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:05.971146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5385f59-3ad7-4755-9a86-3341135b1ef8 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.079835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91df3c-0c62-4650-99d4-c13c6080c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.080731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91df3c-0c62-4650-99d4-c13c6080c41b admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.080731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91df3c-0c62-4650-99d4-c13c6080c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.080950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91df3c-0c62-4650-99d4-c13c6080c41b admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.081595 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91df3c-0c62-4650-99d4-c13c6080c41b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.084343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91df3c-0c62-4650-99d4-c13c6080c41b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.098116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1308/2625] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:06.101699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f1b1-9096-44b6-abcc-60561e249f89 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.118091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f1b1-9096-44b6-abcc-60561e249f89 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.128780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.131209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.131503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.131797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] PATH_INFO: `/v3/projects/29bfc653e4b0460b8e4296e161d85343/users/e8eb2eadb78d458c8e2acfef2cd88fb3/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.134588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29bfc653e4b0460b8e4296e161d85343, user_id=e8eb2eadb78d458c8e2acfef2cd88fb3, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.137347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.167948 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1318/2626] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:06 2022] PUT /identity/v3/projects/29bfc653e4b0460b8e4296e161d85343/users/e8eb2eadb78d458c8e2acfef2cd88fb3/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:45:06.179453 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758fa47-1143-4670-996a-e2dc30516c69 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.179738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758fa47-1143-4670-996a-e2dc30516c69 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.180021 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a758fa47-1143-4670-996a-e2dc30516c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.243889 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a758fa47-1143-4670-996a-e2dc30516c69 None None] MFA Rules not processed for user `e8eb2eadb78d458c8e2acfef2cd88fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:06.245143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a758fa47-1143-4670-996a-e2dc30516c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:06.386630 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1309/2627] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:06.397508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.399623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:06.519229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12717e60-f9ab-4455-a230-c2c64c7aec09 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.525335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1d76-0075-4195-b7eb-3e81a3763f88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.525335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1d76-0075-4195-b7eb-3e81a3763f88 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.525335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1d76-0075-4195-b7eb-3e81a3763f88 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.525335 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda1d76-0075-4195-b7eb-3e81a3763f88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.536662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda1d76-0075-4195-b7eb-3e81a3763f88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.538309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda1d76-0075-4195-b7eb-3e81a3763f88 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.551223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1319/2628] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:06.651504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758fa47-1143-4670-996a-e2dc30516c69 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.653099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a758fa47-1143-4670-996a-e2dc30516c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:06.727061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.734015 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1d76-0075-4195-b7eb-3e81a3763f88 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:06.748454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda1d76-0075-4195-b7eb-3e81a3763f88 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.754797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fe5c8-730d-4c9b-8a4b-8f4dc0e96f8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.755517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe5c8-730d-4c9b-8a4b-8f4dc0e96f8c service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.756333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe5c8-730d-4c9b-8a4b-8f4dc0e96f8c service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.756610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95fe5c8-730d-4c9b-8a4b-8f4dc0e96f8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.768468 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:06.771741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a758fa47-1143-4670-996a-e2dc30516c69 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:06.784514 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:06.785375 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:06.787368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:06.787905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:06.793859 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:06.826756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.829020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.869104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1310/2629] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:06.937603 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fe5c8-730d-4c9b-8a4b-8f4dc0e96f8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:06.939678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95fe5c8-730d-4c9b-8a4b-8f4dc0e96f8c service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:06.961558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1320/2630] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:45:11.659536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:11.661089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:11.773688 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db8cd4-c1a2-4cc6-8c96-1372befb1b22 service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:11.781167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:11.782684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:11.783046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:11.783322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] PATH_INFO: `/v3/users/af6775ff7d674767af4e7d19290cd684` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:11.784812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af6775ff7d674767af4e7d19290cd684)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:11.786798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:11.870459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af6775ff7d674767af4e7d19290cd684'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:11.881695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af6775ff7d674767af4e7d19290cd684'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:11.902468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af6775ff7d674767af4e7d19290cd684'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:11.913802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af6775ff7d674767af4e7d19290cd684'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:11.938949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af6775ff7d674767af4e7d19290cd684'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:11.957985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1311/2631] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:11 2022] DELETE /identity/v3/users/af6775ff7d674767af4e7d19290cd684 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:12.236292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fe5c8-730d-4c9b-8a4b-8f4dc0e96f8c service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.250426 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95fe5c8-730d-4c9b-8a4b-8f4dc0e96f8c service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.392452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.393254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.393645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.395216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] PATH_INFO: `/v3/projects/b821353c40f7461885a9c0cdd7b2705d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.395474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b821353c40f7461885a9c0cdd7b2705d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.400936 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.474287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b821353c40f7461885a9c0cdd7b2705d', 'request_id': 'req-5d8949d8-166a-4bb4-8d7e-f672d451b754'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.483051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b821353c40f7461885a9c0cdd7b2705d', 'request_id': 'req-5d8949d8-166a-4bb4-8d7e-f672d451b754'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.498439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b821353c40f7461885a9c0cdd7b2705d', 'request_id': 'req-5d8949d8-166a-4bb4-8d7e-f672d451b754'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.511959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] The token cache is being invalidate because project b821353c40f7461885a9c0cdd7b2705d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:12.512259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.513001 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.517594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1321/2632] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:12 2022] DELETE /identity/v3/projects/b821353c40f7461885a9c0cdd7b2705d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:12.518849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:12.520503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:12.541712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b848a-7ffe-477e-a1ea-b550d6d835c1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:12.602166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:12.619153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:12.620325 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:12.621164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:12.621446 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] PATH_INFO: `/v3/users/e1ecf6b555b84197a392dcd115e73c79` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:12.622660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ecf6b555b84197a392dcd115e73c79)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:12.624747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:12.691273 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ecf6b555b84197a392dcd115e73c79'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.691920 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ecf6b555b84197a392dcd115e73c79'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.700578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ecf6b555b84197a392dcd115e73c79'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.708316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ecf6b555b84197a392dcd115e73c79'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.726118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ecf6b555b84197a392dcd115e73c79'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:12.733592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1312/2633] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:12 2022] DELETE /identity/v3/users/e1ecf6b555b84197a392dcd115e73c79 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:13.272592 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:13.275797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:13.300434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8949d8-166a-4bb4-8d7e-f672d451b754 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:13.371808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:13.413638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:13.414347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:13.414633 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:13.415493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] PATH_INFO: `/v3/projects/def59a58cbb44dcfbc78c2391ce391e0` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:13.417325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def59a58cbb44dcfbc78c2391ce391e0)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:13.419292 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:13.516211 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def59a58cbb44dcfbc78c2391ce391e0', 'request_id': 'req-f941e7ba-f4bc-4899-91e0-416e480774c9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:13.532495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def59a58cbb44dcfbc78c2391ce391e0', 'request_id': 'req-f941e7ba-f4bc-4899-91e0-416e480774c9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:13.560122 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def59a58cbb44dcfbc78c2391ce391e0', 'request_id': 'req-f941e7ba-f4bc-4899-91e0-416e480774c9'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:13.580295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] The token cache is being invalidate because project def59a58cbb44dcfbc78c2391ce391e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:13.580600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:13.581341 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f941e7ba-f4bc-4899-91e0-416e480774c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:13.595807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1322/2634] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:13 2022] DELETE /identity/v3/projects/def59a58cbb44dcfbc78c2391ce391e0 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:14.937075 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:14.938562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:14.952571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150ab83b-e214-417c-9a91-b4213d91deb5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.025592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.026404 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.026818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.027083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] PATH_INFO: `/v3/users/e681bb85707f4347878bc30cd47e64c6` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.028455 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e681bb85707f4347878bc30cd47e64c6)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.030851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.084319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e681bb85707f4347878bc30cd47e64c6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.085584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e681bb85707f4347878bc30cd47e64c6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.094340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e681bb85707f4347878bc30cd47e64c6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.101950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e681bb85707f4347878bc30cd47e64c6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.109229 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.115771 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e681bb85707f4347878bc30cd47e64c6'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.123973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1313/2635] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:14 2022] DELETE /identity/v3/users/e681bb85707f4347878bc30cd47e64c6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:15.128455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97208b2-49c7-4a3e-962d-a2106424b5ea None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.128949 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97208b2-49c7-4a3e-962d-a2106424b5ea None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.129048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97208b2-49c7-4a3e-962d-a2106424b5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.151383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e97208b2-49c7-4a3e-962d-a2106424b5ea None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:15.152605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e97208b2-49c7-4a3e-962d-a2106424b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:15.213120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1323/2636] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:15.222845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.224251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:15.285332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a097cb-daca-4bdf-a25c-8ff580a27f4f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.289028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa800f-4fae-404a-a6b9-4c9f021a41c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.290200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa800f-4fae-404a-a6b9-4c9f021a41c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.290729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa800f-4fae-404a-a6b9-4c9f021a41c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.291070 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa800f-4fae-404a-a6b9-4c9f021a41c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.300108 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa800f-4fae-404a-a6b9-4c9f021a41c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.301546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa800f-4fae-404a-a6b9-4c9f021a41c3 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.311746 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1314/2637] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:15.579992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97208b2-49c7-4a3e-962d-a2106424b5ea None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.581531 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e97208b2-49c7-4a3e-962d-a2106424b5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:15.596651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97208b2-49c7-4a3e-962d-a2106424b5ea None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.601811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.603315 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.603666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.604007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] PATH_INFO: `/v3/projects/1d5bb88574324c03ba4c7def3dbd5100` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.605248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d5bb88574324c03ba4c7def3dbd5100)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.607640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.658441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d5bb88574324c03ba4c7def3dbd5100', 'request_id': 'req-fb2d1acb-177a-411e-a3d0-27729d75fa26'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.665609 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d5bb88574324c03ba4c7def3dbd5100', 'request_id': 'req-fb2d1acb-177a-411e-a3d0-27729d75fa26'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.674594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d5bb88574324c03ba4c7def3dbd5100', 'request_id': 'req-fb2d1acb-177a-411e-a3d0-27729d75fa26'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.676650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:15.687487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] The token cache is being invalidate because project 1d5bb88574324c03ba4c7def3dbd5100 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:15.687794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.688537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.690755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1324/2638] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:15 2022] DELETE /identity/v3/projects/1d5bb88574324c03ba4c7def3dbd5100 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:15.694597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa800f-4fae-404a-a6b9-4c9f021a41c3 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:15.704995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa800f-4fae-404a-a6b9-4c9f021a41c3 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:15.763986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:15.764629 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:15.764911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:15.765185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] PATH_INFO: `/v3/users/e8eb2eadb78d458c8e2acfef2cd88fb3` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:15.766361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8eb2eadb78d458c8e2acfef2cd88fb3)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:15.768281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:15.816759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8eb2eadb78d458c8e2acfef2cd88fb3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.817429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8eb2eadb78d458c8e2acfef2cd88fb3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.824749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8eb2eadb78d458c8e2acfef2cd88fb3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.831795 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8eb2eadb78d458c8e2acfef2cd88fb3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.844318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-3b789630-d772-4af9-8299-e008695c2344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8eb2eadb78d458c8e2acfef2cd88fb3'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:15.850201 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1315/2639] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:15 2022] DELETE /identity/v3/users/e8eb2eadb78d458c8e2acfef2cd88fb3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:45:16.381749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.383231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:16.398138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2d1acb-177a-411e-a3d0-27729d75fa26 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.465542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.466221 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.466511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.466815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] PATH_INFO: `/v3/projects/29bfc653e4b0460b8e4296e161d85343` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.467953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] RBAC: Authorizing `identity:delete_project(project_id=29bfc653e4b0460b8e4296e161d85343)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.469884 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.518098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29bfc653e4b0460b8e4296e161d85343', 'request_id': 'req-4399011a-1d4c-49c9-9674-71c49fa1479d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:16.524454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29bfc653e4b0460b8e4296e161d85343', 'request_id': 'req-4399011a-1d4c-49c9-9674-71c49fa1479d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:16.531673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29bfc653e4b0460b8e4296e161d85343', 'request_id': 'req-4399011a-1d4c-49c9-9674-71c49fa1479d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:16.542532 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] The token cache is being invalidate because project 29bfc653e4b0460b8e4296e161d85343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:16.542826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:16.543451 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-4399011a-1d4c-49c9-9674-71c49fa1479d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:16.544916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1325/2640] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:16 2022] DELETE /identity/v3/projects/29bfc653e4b0460b8e4296e161d85343 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:16.549802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89bde-89c3-4982-ba52-f599ed4cd836 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.550304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89bde-89c3-4982-ba52-f599ed4cd836 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.550421 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa89bde-89c3-4982-ba52-f599ed4cd836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.572067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-1fa89bde-89c3-4982-ba52-f599ed4cd836 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:16.573992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1fa89bde-89c3-4982-ba52-f599ed4cd836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:16.581345 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:16.644936 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1316/2641] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:16.652926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1e49-081f-4ed1-8f12-5e25f77c00f7 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.653297 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1e49-081f-4ed1-8f12-5e25f77c00f7 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.653653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f1e49-081f-4ed1-8f12-5e25f77c00f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.674404 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-217f1e49-081f-4ed1-8f12-5e25f77c00f7 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:16.675616 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-217f1e49-081f-4ed1-8f12-5e25f77c00f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:16.684295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1326/2642] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:16.688499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa89bde-89c3-4982-ba52-f599ed4cd836 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.698881 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa89bde-89c3-4982-ba52-f599ed4cd836 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.703397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.703992 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.704272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.704542 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.705189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:16.705491 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.707180 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.719071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1317/2643] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:16.723413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1e49-081f-4ed1-8f12-5e25f77c00f7 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.732674 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f1e49-081f-4ed1-8f12-5e25f77c00f7 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.737303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b77df-b104-416c-9714-3a103467eb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.737918 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b77df-b104-416c-9714-3a103467eb11 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.738206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b77df-b104-416c-9714-3a103467eb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.738480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b77df-b104-416c-9714-3a103467eb11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.739105 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b77df-b104-416c-9714-3a103467eb11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.741007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b77df-b104-416c-9714-3a103467eb11 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.771259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1327/2644] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:16 2022] POST /identity/v3/projects => generated 357 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:16.775377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.785718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eff53bc-a812-4fba-ad4e-bfbccad86a35 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.852750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa348-c53d-46df-8a06-bac22b279be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.853568 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa348-c53d-46df-8a06-bac22b279be3 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.853856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa348-c53d-46df-8a06-bac22b279be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.854173 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8baa348-c53d-46df-8a06-bac22b279be3 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.854818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baa348-c53d-46df-8a06-bac22b279be3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.856744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8baa348-c53d-46df-8a06-bac22b279be3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.878668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1318/2645] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:16 2022] POST /identity/v3/users => generated 279 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:16.882862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b77df-b104-416c-9714-3a103467eb11 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.893538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b77df-b104-416c-9714-3a103467eb11 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.898282 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eefe9-a66b-4563-b15a-558b9f4a9dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.898885 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eefe9-a66b-4563-b15a-558b9f4a9dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.899234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eefe9-a66b-4563-b15a-558b9f4a9dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.899506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eefe9-a66b-4563-b15a-558b9f4a9dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.900143 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eefe9-a66b-4563-b15a-558b9f4a9dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.901714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eefe9-a66b-4563-b15a-558b9f4a9dd7 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.912117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1328/2646] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:16.916930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa348-c53d-46df-8a06-bac22b279be3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.927616 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8baa348-c53d-46df-8a06-bac22b279be3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.933993 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496337e-edf1-4eac-9f5d-3623e56571de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.934652 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496337e-edf1-4eac-9f5d-3623e56571de admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.934972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496337e-edf1-4eac-9f5d-3623e56571de admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.935307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496337e-edf1-4eac-9f5d-3623e56571de admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.936001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496337e-edf1-4eac-9f5d-3623e56571de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.937760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496337e-edf1-4eac-9f5d-3623e56571de admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:16.949169 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1319/2647] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:16.953396 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eefe9-a66b-4563-b15a-558b9f4a9dd7 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:16.963792 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eefe9-a66b-4563-b15a-558b9f4a9dd7 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:16.968769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7670be-a109-4da7-80a9-bcba4ce7e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:16.969602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7670be-a109-4da7-80a9-bcba4ce7e283 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:16.969991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7670be-a109-4da7-80a9-bcba4ce7e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:16.970327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7670be-a109-4da7-80a9-bcba4ce7e283 admin admin] PATH_INFO: `/v3/projects/46dae6a9b61648478e6be61628720d84/users/9308228851584d7bb19af5ed23b86ba7/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:16.986424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7670be-a109-4da7-80a9-bcba4ce7e283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46dae6a9b61648478e6be61628720d84, user_id=9308228851584d7bb19af5ed23b86ba7, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:16.989173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7670be-a109-4da7-80a9-bcba4ce7e283 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.003176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1329/2648] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:16 2022] PUT /identity/v3/projects/46dae6a9b61648478e6be61628720d84/users/9308228851584d7bb19af5ed23b86ba7/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:17.013272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb4fe-7a02-4cdd-a8a6-9081a5781643 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.013690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb4fe-7a02-4cdd-a8a6-9081a5781643 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.014105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcb4fe-7a02-4cdd-a8a6-9081a5781643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.044544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-33fcb4fe-7a02-4cdd-a8a6-9081a5781643 None None] MFA Rules not processed for user `9308228851584d7bb19af5ed23b86ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:17.045953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-33fcb4fe-7a02-4cdd-a8a6-9081a5781643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:17.113825 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1320/2649] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:17 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:17.119028 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7670be-a109-4da7-80a9-bcba4ce7e283 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.139907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.185316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7670be-a109-4da7-80a9-bcba4ce7e283 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.189919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f7463-5666-4f08-a4b3-dc7afaf85cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.190517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7463-5666-4f08-a4b3-dc7afaf85cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.190796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7463-5666-4f08-a4b3-dc7afaf85cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.191068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80f7463-5666-4f08-a4b3-dc7afaf85cf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.191723 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f7463-5666-4f08-a4b3-dc7afaf85cf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.193596 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80f7463-5666-4f08-a4b3-dc7afaf85cf5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.219651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1330/2650] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:17 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:17.223712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcb4fe-7a02-4cdd-a8a6-9081a5781643 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.235392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcb4fe-7a02-4cdd-a8a6-9081a5781643 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.239001 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.294653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8e4d-d4dd-4c06-981d-ea735bbb7b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.295320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8e4d-d4dd-4c06-981d-ea735bbb7b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.295544 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8e4d-d4dd-4c06-981d-ea735bbb7b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.295822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb8e4d-d4dd-4c06-981d-ea735bbb7b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.296465 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb8e4d-d4dd-4c06-981d-ea735bbb7b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.298425 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fb8e4d-d4dd-4c06-981d-ea735bbb7b8b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.321471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1321/2651] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:17 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:17.325425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f7463-5666-4f08-a4b3-dc7afaf85cf5 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.336613 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80f7463-5666-4f08-a4b3-dc7afaf85cf5 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.341732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b7c9-92e4-46c4-97a1-b3f6bceaee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.342392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b7c9-92e4-46c4-97a1-b3f6bceaee1f admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.342682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b7c9-92e4-46c4-97a1-b3f6bceaee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.342960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5b7c9-92e4-46c4-97a1-b3f6bceaee1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.343645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5b7c9-92e4-46c4-97a1-b3f6bceaee1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.345269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5b7c9-92e4-46c4-97a1-b3f6bceaee1f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.357229 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1331/2652] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:17.361278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8e4d-d4dd-4c06-981d-ea735bbb7b8b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.372251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb8e4d-d4dd-4c06-981d-ea735bbb7b8b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.376949 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba89e4-fdd5-4172-981b-3664cb8e7aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.377631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba89e4-fdd5-4172-981b-3664cb8e7aef admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.377989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba89e4-fdd5-4172-981b-3664cb8e7aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.378275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ba89e4-fdd5-4172-981b-3664cb8e7aef admin admin] PATH_INFO: `/v3/projects/a0893ebd18844ada8f75bf5adfec7ec6/users/581bea56f3a44d8f80195bfe0fbe566d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.394347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba89e4-fdd5-4172-981b-3664cb8e7aef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0893ebd18844ada8f75bf5adfec7ec6, user_id=581bea56f3a44d8f80195bfe0fbe566d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.397067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ba89e4-fdd5-4172-981b-3664cb8e7aef admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.411938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1322/2653] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:17 2022] PUT /identity/v3/projects/a0893ebd18844ada8f75bf5adfec7ec6/users/581bea56f3a44d8f80195bfe0fbe566d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:17.416035 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b7c9-92e4-46c4-97a1-b3f6bceaee1f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.426080 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5b7c9-92e4-46c4-97a1-b3f6bceaee1f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.485452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6fb967-b1a3-4ded-86c2-fd948c328695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.486092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb967-b1a3-4ded-86c2-fd948c328695 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.486382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb967-b1a3-4ded-86c2-fd948c328695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.486661 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6fb967-b1a3-4ded-86c2-fd948c328695 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.487305 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb967-b1a3-4ded-86c2-fd948c328695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.488906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6fb967-b1a3-4ded-86c2-fd948c328695 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.499056 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1332/2654] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:17.503368 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba89e4-fdd5-4172-981b-3664cb8e7aef admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.514272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ba89e4-fdd5-4172-981b-3664cb8e7aef admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.518845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.519490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.519772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.520046 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] PATH_INFO: `/v3/projects/a0893ebd18844ada8f75bf5adfec7ec6/users/581bea56f3a44d8f80195bfe0fbe566d/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.521961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0893ebd18844ada8f75bf5adfec7ec6, user_id=581bea56f3a44d8f80195bfe0fbe566d, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.524769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.535081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1323/2655] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:17 2022] PUT /identity/v3/projects/a0893ebd18844ada8f75bf5adfec7ec6/users/581bea56f3a44d8f80195bfe0fbe566d/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:17.546975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5720-8ca1-44de-afd9-134319dbf9f0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.547265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5720-8ca1-44de-afd9-134319dbf9f0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.547547 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5720-8ca1-44de-afd9-134319dbf9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.576152 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-663d5720-8ca1-44de-afd9-134319dbf9f0 None None] MFA Rules not processed for user `581bea56f3a44d8f80195bfe0fbe566d`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:17.577376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-663d5720-8ca1-44de-afd9-134319dbf9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:17.645980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1333/2656] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:17 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:17.657274 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.659097 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:17.721318 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65abe7c4-10c1-4196-a863-8dac45f25928 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.724928 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.725533 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.725814 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.726119 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.735947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.737382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.747885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1324/2657] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:17.822375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5720-8ca1-44de-afd9-134319dbf9f0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:17.832055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5720-8ca1-44de-afd9-134319dbf9f0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:17.835797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9295d1-4b27-4900-9dc5-70fc4b326537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:17.836431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9295d1-4b27-4900-9dc5-70fc4b326537 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:17.836715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9295d1-4b27-4900-9dc5-70fc4b326537 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:17.836992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9295d1-4b27-4900-9dc5-70fc4b326537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:17.846577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:17.894040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9295d1-4b27-4900-9dc5-70fc4b326537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:17.895477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9295d1-4b27-4900-9dc5-70fc4b326537 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:17.904427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1334/2658] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:17 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:20.443919 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:20.445530 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:20.507810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10bb21d-ba94-4c85-a208-4d26551163a4 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:20.511839 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d9112-2df9-4ad6-b108-71b225d9e524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:20.512480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d9112-2df9-4ad6-b108-71b225d9e524 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.512855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d9112-2df9-4ad6-b108-71b225d9e524 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.513104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d9112-2df9-4ad6-b108-71b225d9e524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.515123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9b6d9112-2df9-4ad6-b108-71b225d9e524 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:20.526251 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d9112-2df9-4ad6-b108-71b225d9e524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:20.527817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d9112-2df9-4ad6-b108-71b225d9e524 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:20.537574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1325/2659] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:20.692947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835cb3-0d8a-4b77-afc6-1e8fbf5a85e8 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.693460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835cb3-0d8a-4b77-afc6-1e8fbf5a85e8 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.693460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51835cb3-0d8a-4b77-afc6-1e8fbf5a85e8 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.695187 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1335/2660] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:45:20.700566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9ac5-bf77-4901-b95c-10caa201912c None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.700856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9ac5-bf77-4901-b95c-10caa201912c None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.701134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f9ac5-bf77-4901-b95c-10caa201912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.709756 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:20.722860 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-6b3f9ac5-bf77-4901-b95c-10caa201912c None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:20.724093 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6b3f9ac5-bf77-4901-b95c-10caa201912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:20.804478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1326/2661] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:45:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:20.817592 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51835cb3-0d8a-4b77-afc6-1e8fbf5a85e8 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:20.821972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-51835cb3-0d8a-4b77-afc6-1e8fbf5a85e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:20.889375 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51835cb3-0d8a-4b77-afc6-1e8fbf5a85e8 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:20.893117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcf657c-438b-4fff-8a8e-516fc324dc96 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be2cb98356b4d628408d094589a83e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:20.893822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf657c-438b-4fff-8a8e-516fc324dc96 service glance] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:20.894175 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf657c-438b-4fff-8a8e-516fc324dc96 service glance] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:20.894554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcf657c-438b-4fff-8a8e-516fc324dc96 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:20.907469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf657c-438b-4fff-8a8e-516fc324dc96 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:20.908914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcf657c-438b-4fff-8a8e-516fc324dc96 service glance] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:20.922320 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1336/2662] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:21.687028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40865dc-d25a-4cdb-af0d-438719c2e03b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:21.687551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40865dc-d25a-4cdb-af0d-438719c2e03b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:21.687551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40865dc-d25a-4cdb-af0d-438719c2e03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:21.706986 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a40865dc-d25a-4cdb-af0d-438719c2e03b None None] MFA Rules not processed for user `21295fabeb1349a7a21d602fcbdbdf0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:21.708221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a40865dc-d25a-4cdb-af0d-438719c2e03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:21.775142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1327/2663] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:23.809071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8fb22-d569-4478-830b-ebf041de61bc None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.809585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8fb22-d569-4478-830b-ebf041de61bc None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.809694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8fb22-d569-4478-830b-ebf041de61bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:23.830605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-f0a8fb22-d569-4478-830b-ebf041de61bc None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:23.832322 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f0a8fb22-d569-4478-830b-ebf041de61bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:23.895254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1337/2664] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:45:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:23.907622 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40865dc-d25a-4cdb-af0d-438719c2e03b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:23.909054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a40865dc-d25a-4cdb-af0d-438719c2e03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:23.988334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40865dc-d25a-4cdb-af0d-438719c2e03b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:23.994128 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc639d8-0d47-4de5-9a03-af379127c789 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:23.994863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc639d8-0d47-4de5-9a03-af379127c789 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:23.995148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc639d8-0d47-4de5-9a03-af379127c789 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:23.995428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc639d8-0d47-4de5-9a03-af379127c789 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:24.004008 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc639d8-0d47-4de5-9a03-af379127c789 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:24.005626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc639d8-0d47-4de5-9a03-af379127c789 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:24.014673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1328/2665] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:45:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:45:33.390123 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8fb22-d569-4478-830b-ebf041de61bc None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.463049 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8fb22-d569-4478-830b-ebf041de61bc None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.467652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.468330 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.468611 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.468886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] PATH_INFO: `/v3/users/9308228851584d7bb19af5ed23b86ba7` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.470103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9308228851584d7bb19af5ed23b86ba7)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.472054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.474088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:33.526755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9308228851584d7bb19af5ed23b86ba7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:33.540847 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9308228851584d7bb19af5ed23b86ba7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:33.541591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9308228851584d7bb19af5ed23b86ba7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:33.549780 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9308228851584d7bb19af5ed23b86ba7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:33.558435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9308228851584d7bb19af5ed23b86ba7'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:33.564599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1338/2666] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:33 2022] DELETE /identity/v3/users/9308228851584d7bb19af5ed23b86ba7 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:33.569314 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce533f16-95f6-4535-af33-43dd24514c50 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.574472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce533f16-95f6-4535-af33-43dd24514c50 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.574779 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce533f16-95f6-4535-af33-43dd24514c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.595481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ce533f16-95f6-4535-af33-43dd24514c50 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:33.596717 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ce533f16-95f6-4535-af33-43dd24514c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:33.625377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=100 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:33.669558 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1329/2667] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:33.680181 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:33.681904 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:33.748951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4012a1-0bf8-4e42-b99b-a1bbcbbbea55 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:33.752634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327d7d-7300-4bd5-a065-33f2c90a971b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:33.753248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327d7d-7300-4bd5-a065-33f2c90a971b service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:33.753535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327d7d-7300-4bd5-a065-33f2c90a971b service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:33.753811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a327d7d-7300-4bd5-a065-33f2c90a971b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:33.763732 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a327d7d-7300-4bd5-a065-33f2c90a971b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:33.765326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a327d7d-7300-4bd5-a065-33f2c90a971b service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:33.776109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1339/2668] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:45:34.196428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce533f16-95f6-4535-af33-43dd24514c50 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:34.198027 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ce533f16-95f6-4535-af33-43dd24514c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:34.210114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce533f16-95f6-4535-af33-43dd24514c50 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.215961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:34.216631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.216896 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.217176 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] PATH_INFO: `/v3/projects/46dae6a9b61648478e6be61628720d84` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.218495 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46dae6a9b61648478e6be61628720d84)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:34.220437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:34.274087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46dae6a9b61648478e6be61628720d84', 'request_id': 'req-5eddff8e-a23a-4c46-8911-634b1245eca1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.280037 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46dae6a9b61648478e6be61628720d84', 'request_id': 'req-5eddff8e-a23a-4c46-8911-634b1245eca1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.289033 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46dae6a9b61648478e6be61628720d84', 'request_id': 'req-5eddff8e-a23a-4c46-8911-634b1245eca1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.301164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] The token cache is being invalidate because project 46dae6a9b61648478e6be61628720d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:34.301460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.302131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.303614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1330/2669] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:34 2022] DELETE /identity/v3/projects/46dae6a9b61648478e6be61628720d84 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:34.308287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327d7d-7300-4bd5-a065-33f2c90a971b service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:34.318408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a327d7d-7300-4bd5-a065-33f2c90a971b service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.377060 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:34.377639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.378066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.378370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] PATH_INFO: `/v3/users/581bea56f3a44d8f80195bfe0fbe566d` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.379514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=581bea56f3a44d8f80195bfe0fbe566d)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:34.381494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:34.404085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:34.428905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '581bea56f3a44d8f80195bfe0fbe566d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.441696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '581bea56f3a44d8f80195bfe0fbe566d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.442389 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '581bea56f3a44d8f80195bfe0fbe566d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.449543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '581bea56f3a44d8f80195bfe0fbe566d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.456514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-ea4c0373-0bcb-4440-8559-3e661b7b8a3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '581bea56f3a44d8f80195bfe0fbe566d'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.463186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1340/2670] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:34 2022] DELETE /identity/v3/users/581bea56f3a44d8f80195bfe0fbe566d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:34.747843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:34.751161 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:34.766193 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddff8e-a23a-4c46-8911-634b1245eca1 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:34.829865 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:34.830534 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.830847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.831682 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] PATH_INFO: `/v3/projects/a0893ebd18844ada8f75bf5adfec7ec6` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:34.833062 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0893ebd18844ada8f75bf5adfec7ec6)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:34.834874 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:34.904028 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0893ebd18844ada8f75bf5adfec7ec6', 'request_id': 'req-e81d7565-3e6c-4460-bef9-462c60b6ce9c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.910406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:34.912187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0893ebd18844ada8f75bf5adfec7ec6', 'request_id': 'req-e81d7565-3e6c-4460-bef9-462c60b6ce9c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.939727 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0893ebd18844ada8f75bf5adfec7ec6', 'request_id': 'req-e81d7565-3e6c-4460-bef9-462c60b6ce9c'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.963082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] The token cache is being invalidate because project a0893ebd18844ada8f75bf5adfec7ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:34.963382 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.964118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e81d7565-3e6c-4460-bef9-462c60b6ce9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:34.967395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1331/2671] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:34 2022] DELETE /identity/v3/projects/a0893ebd18844ada8f75bf5adfec7ec6 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:34.972515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bea16-1388-446f-8bc8-3de641ecf0dd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:34.973038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bea16-1388-446f-8bc8-3de641ecf0dd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:34.973942 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2bea16-1388-446f-8bc8-3de641ecf0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.009469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ec2bea16-1388-446f-8bc8-3de641ecf0dd None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:35.011207 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ec2bea16-1388-446f-8bc8-3de641ecf0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:35.100256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1341/2672] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:45:35.123007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558f81-4e2f-4685-8d77-89c981114b82 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.123007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558f81-4e2f-4685-8d77-89c981114b82 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.123007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96558f81-4e2f-4685-8d77-89c981114b82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.136594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-96558f81-4e2f-4685-8d77-89c981114b82 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:35.138034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-96558f81-4e2f-4685-8d77-89c981114b82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:35.152867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bea16-1388-446f-8bc8-3de641ecf0dd None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.154934 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1332/2673] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:35.163176 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2bea16-1388-446f-8bc8-3de641ecf0dd None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.170575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.171230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.171620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.171906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.172594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:35.172903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.174535 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.187075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1342/2674] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:35.191371 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96558f81-4e2f-4685-8d77-89c981114b82 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.201507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96558f81-4e2f-4685-8d77-89c981114b82 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.206261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011807-713f-4ab8-9b08-8a390b0340b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.206971 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011807-713f-4ab8-9b08-8a390b0340b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.207261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011807-713f-4ab8-9b08-8a390b0340b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.207537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68011807-713f-4ab8-9b08-8a390b0340b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.208199 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011807-713f-4ab8-9b08-8a390b0340b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.210131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68011807-713f-4ab8-9b08-8a390b0340b7 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.237636 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1333/2675] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:35 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:35.242149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.252289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e9d0d-ce43-46bc-986d-249156abddf1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.312159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a883602-cd12-42e4-a1ef-ca783772df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.312759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883602-cd12-42e4-a1ef-ca783772df43 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.313040 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883602-cd12-42e4-a1ef-ca783772df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.313309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a883602-cd12-42e4-a1ef-ca783772df43 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.313951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a883602-cd12-42e4-a1ef-ca783772df43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.315862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a883602-cd12-42e4-a1ef-ca783772df43 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.336695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1343/2676] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:35 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:35.340797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011807-713f-4ab8-9b08-8a390b0340b7 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.351335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68011807-713f-4ab8-9b08-8a390b0340b7 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.356042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12983c9-7756-4652-a5c3-f4e7c4ed9062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.356646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12983c9-7756-4652-a5c3-f4e7c4ed9062 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.356926 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12983c9-7756-4652-a5c3-f4e7c4ed9062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.357198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12983c9-7756-4652-a5c3-f4e7c4ed9062 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.357842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12983c9-7756-4652-a5c3-f4e7c4ed9062 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.359475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12983c9-7756-4652-a5c3-f4e7c4ed9062 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.370647 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1334/2677] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:35.374860 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a883602-cd12-42e4-a1ef-ca783772df43 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.385790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a883602-cd12-42e4-a1ef-ca783772df43 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.391350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383845a5-bef7-4d4a-a301-ba8e88330ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.391958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383845a5-bef7-4d4a-a301-ba8e88330ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.392240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383845a5-bef7-4d4a-a301-ba8e88330ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.392514 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383845a5-bef7-4d4a-a301-ba8e88330ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.393754 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383845a5-bef7-4d4a-a301-ba8e88330ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.395594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383845a5-bef7-4d4a-a301-ba8e88330ac3 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.408200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1344/2678] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:35.412555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12983c9-7756-4652-a5c3-f4e7c4ed9062 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.430099 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12983c9-7756-4652-a5c3-f4e7c4ed9062 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.436441 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357aa25-3d99-4652-90f2-b67ea4275d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.437112 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357aa25-3d99-4652-90f2-b67ea4275d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.437396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357aa25-3d99-4652-90f2-b67ea4275d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.437676 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357aa25-3d99-4652-90f2-b67ea4275d70 admin admin] PATH_INFO: `/v3/projects/c6c189105f08400aa1b93c014d8e2f74/users/b78b900895cc4c99bc5ab314ef32a19b/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.453740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357aa25-3d99-4652-90f2-b67ea4275d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c189105f08400aa1b93c014d8e2f74, user_id=b78b900895cc4c99bc5ab314ef32a19b, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.456467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357aa25-3d99-4652-90f2-b67ea4275d70 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.471484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1335/2679] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:35 2022] PUT /identity/v3/projects/c6c189105f08400aa1b93c014d8e2f74/users/b78b900895cc4c99bc5ab314ef32a19b/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:35.483755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab91f5-1673-4e18-be44-134d9353783b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.484303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab91f5-1673-4e18-be44-134d9353783b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.484682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab91f5-1673-4e18-be44-134d9353783b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.499242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:35.516582 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-abab91f5-1673-4e18-be44-134d9353783b None None] MFA Rules not processed for user `b78b900895cc4c99bc5ab314ef32a19b`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:35.517815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-abab91f5-1673-4e18-be44-134d9353783b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:35.584222 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1345/2680] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:35 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:35.588844 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357aa25-3d99-4652-90f2-b67ea4275d70 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.649361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357aa25-3d99-4652-90f2-b67ea4275d70 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.653977 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230ca2f-c200-43cf-9a41-c50ba62f8b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.654579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230ca2f-c200-43cf-9a41-c50ba62f8b22 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.654860 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230ca2f-c200-43cf-9a41-c50ba62f8b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.655135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230ca2f-c200-43cf-9a41-c50ba62f8b22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.655769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230ca2f-c200-43cf-9a41-c50ba62f8b22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.657964 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230ca2f-c200-43cf-9a41-c50ba62f8b22 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.684510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1336/2681] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:35 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:45:35.688886 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab91f5-1673-4e18-be44-134d9353783b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.699412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab91f5-1673-4e18-be44-134d9353783b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.754374 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ff038-5e1e-410e-a127-7b0927e687df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.754932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ff038-5e1e-410e-a127-7b0927e687df admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.755216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ff038-5e1e-410e-a127-7b0927e687df admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.755494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ff038-5e1e-410e-a127-7b0927e687df admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.756169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ff038-5e1e-410e-a127-7b0927e687df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.758144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ff038-5e1e-410e-a127-7b0927e687df admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.779537 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1346/2682] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:35 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:35.783815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230ca2f-c200-43cf-9a41-c50ba62f8b22 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.794701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230ca2f-c200-43cf-9a41-c50ba62f8b22 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.799329 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9560b3-3f45-449f-b28a-7236638cd629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.799933 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9560b3-3f45-449f-b28a-7236638cd629 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.800214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9560b3-3f45-449f-b28a-7236638cd629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.800490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9560b3-3f45-449f-b28a-7236638cd629 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.801132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9560b3-3f45-449f-b28a-7236638cd629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.802798 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9560b3-3f45-449f-b28a-7236638cd629 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.813736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1337/2683] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:35.817680 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ff038-5e1e-410e-a127-7b0927e687df admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.827809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ff038-5e1e-410e-a127-7b0927e687df admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.832425 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5d565-a7bb-4a73-8fca-eb545df52e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.833010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d565-a7bb-4a73-8fca-eb545df52e05 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.833295 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d565-a7bb-4a73-8fca-eb545df52e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.833569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5d565-a7bb-4a73-8fca-eb545df52e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.834253 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5d565-a7bb-4a73-8fca-eb545df52e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.835923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5d565-a7bb-4a73-8fca-eb545df52e05 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.845677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1347/2684] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:35.849536 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9560b3-3f45-449f-b28a-7236638cd629 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:35.859981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9560b3-3f45-449f-b28a-7236638cd629 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:35.864662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd8f3e-16a7-445f-a970-868ccca88294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:35.865298 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd8f3e-16a7-445f-a970-868ccca88294 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.865582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd8f3e-16a7-445f-a970-868ccca88294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.865859 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd8f3e-16a7-445f-a970-868ccca88294 admin admin] PATH_INFO: `/v3/projects/b6c03173ebfc4fd19fb89868acbc1d84/users/bbdfdcd1e6044273a99ff8537d84d34e/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.880760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd8f3e-16a7-445f-a970-868ccca88294 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c03173ebfc4fd19fb89868acbc1d84, user_id=bbdfdcd1e6044273a99ff8537d84d34e, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:35.883481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fd8f3e-16a7-445f-a970-868ccca88294 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:35.896823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1338/2685] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:35 2022] PUT /identity/v3/projects/b6c03173ebfc4fd19fb89868acbc1d84/users/bbdfdcd1e6044273a99ff8537d84d34e/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:35.907099 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39028c-5089-4627-abf8-db69b2456258 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:35.907419 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39028c-5089-4627-abf8-db69b2456258 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:35.907696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f39028c-5089-4627-abf8-db69b2456258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:35.938592 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-9f39028c-5089-4627-abf8-db69b2456258 None None] MFA Rules not processed for user `bbdfdcd1e6044273a99ff8537d84d34e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:35.939825 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-9f39028c-5089-4627-abf8-db69b2456258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:36.003574 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1348/2686] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:45:36.008470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd8f3e-16a7-445f-a970-868ccca88294 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.042780 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:36.073712 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd8f3e-16a7-445f-a970-868ccca88294 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.078487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d2c5-47f9-44ff-ae54-900e90477117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.079092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d2c5-47f9-44ff-ae54-900e90477117 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.079377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d2c5-47f9-44ff-ae54-900e90477117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.079653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da62d2c5-47f9-44ff-ae54-900e90477117 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.080272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62d2c5-47f9-44ff-ae54-900e90477117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.082221 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da62d2c5-47f9-44ff-ae54-900e90477117 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.108105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1339/2687] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:36 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:36.112132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39028c-5089-4627-abf8-db69b2456258 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.119210 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:36.123694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f39028c-5089-4627-abf8-db69b2456258 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.186846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c54762-0294-476c-9a1e-f9e91e8f3fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.188027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54762-0294-476c-9a1e-f9e91e8f3fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.188027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54762-0294-476c-9a1e-f9e91e8f3fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.188213 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c54762-0294-476c-9a1e-f9e91e8f3fdb admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.188790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c54762-0294-476c-9a1e-f9e91e8f3fdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.190765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c54762-0294-476c-9a1e-f9e91e8f3fdb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.216828 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1349/2688] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:36 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:36.221393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d2c5-47f9-44ff-ae54-900e90477117 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.233216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da62d2c5-47f9-44ff-ae54-900e90477117 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.238417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2d444-5ad0-4321-9bcc-de7b6465eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.239040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2d444-5ad0-4321-9bcc-de7b6465eb22 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.239319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2d444-5ad0-4321-9bcc-de7b6465eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.239588 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb2d444-5ad0-4321-9bcc-de7b6465eb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.240238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2d444-5ad0-4321-9bcc-de7b6465eb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.242396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb2d444-5ad0-4321-9bcc-de7b6465eb22 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.253308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1340/2689] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:36.258345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c54762-0294-476c-9a1e-f9e91e8f3fdb admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.269364 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c54762-0294-476c-9a1e-f9e91e8f3fdb admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.274333 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cfd40-d2c7-4da1-9530-13f305c36c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.274989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cfd40-d2c7-4da1-9530-13f305c36c41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.275270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cfd40-d2c7-4da1-9530-13f305c36c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.275545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817cfd40-d2c7-4da1-9530-13f305c36c41 admin admin] PATH_INFO: `/v3/projects/bc392464e61d46cf9c0df1f8260f1bb2/users/366aa0a41ee94431bfdc505722462c38/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.292756 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cfd40-d2c7-4da1-9530-13f305c36c41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc392464e61d46cf9c0df1f8260f1bb2, user_id=366aa0a41ee94431bfdc505722462c38, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.295466 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817cfd40-d2c7-4da1-9530-13f305c36c41 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.311231 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1350/2690] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:36 2022] PUT /identity/v3/projects/bc392464e61d46cf9c0df1f8260f1bb2/users/366aa0a41ee94431bfdc505722462c38/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:45:36.315591 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2d444-5ad0-4321-9bcc-de7b6465eb22 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.326753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb2d444-5ad0-4321-9bcc-de7b6465eb22 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.388923 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e3f1d-2f22-467c-a58f-f88e04613f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.389560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e3f1d-2f22-467c-a58f-f88e04613f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.389840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e3f1d-2f22-467c-a58f-f88e04613f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.390146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e3f1d-2f22-467c-a58f-f88e04613f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.390801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e3f1d-2f22-467c-a58f-f88e04613f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.392546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e3f1d-2f22-467c-a58f-f88e04613f81 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.403198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1341/2691] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:45:36.407793 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cfd40-d2c7-4da1-9530-13f305c36c41 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.419388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817cfd40-d2c7-4da1-9530-13f305c36c41 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.424276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.424960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.425339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.425627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] PATH_INFO: `/v3/projects/bc392464e61d46cf9c0df1f8260f1bb2/users/366aa0a41ee94431bfdc505722462c38/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.427651 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc392464e61d46cf9c0df1f8260f1bb2, user_id=366aa0a41ee94431bfdc505722462c38, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.431009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.441241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1351/2692] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:36 2022] PUT /identity/v3/projects/bc392464e61d46cf9c0df1f8260f1bb2/users/366aa0a41ee94431bfdc505722462c38/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:36.452153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a501a1-ca6a-4348-a430-7c6031556682 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.452438 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a501a1-ca6a-4348-a430-7c6031556682 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.452718 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a501a1-ca6a-4348-a430-7c6031556682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.480140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-e9a501a1-ca6a-4348-a430-7c6031556682 None None] MFA Rules not processed for user `366aa0a41ee94431bfdc505722462c38`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:36.481340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e9a501a1-ca6a-4348-a430-7c6031556682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:36.551703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1342/2693] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:36.562903 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:36.564621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:36.623298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e98fb-6074-4ad8-af31-02242ff7ba4f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:36.626987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732596b-89bc-4b16-ba40-11a807623d42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:36.627608 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732596b-89bc-4b16-ba40-11a807623d42 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:36.627892 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732596b-89bc-4b16-ba40-11a807623d42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:36.628169 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732596b-89bc-4b16-ba40-11a807623d42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:36.637501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732596b-89bc-4b16-ba40-11a807623d42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:36.638975 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732596b-89bc-4b16-ba40-11a807623d42 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:36.648933 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1352/2694] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:36 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:37.154315 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a501a1-ca6a-4348-a430-7c6031556682 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:37.155755 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e9a501a1-ca6a-4348-a430-7c6031556682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:37.168838 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a501a1-ca6a-4348-a430-7c6031556682 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:37.173466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:37.173904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:37.174418 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:37.174769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:37.206662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:37.241837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:37.243515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:37.261943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1343/2695] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:39.502599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5b9b-6ee7-414d-856c-965691528384 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:39.503098 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5b9b-6ee7-414d-856c-965691528384 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:39.503205 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb5b9b-6ee7-414d-856c-965691528384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:39.522475 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-81fb5b9b-6ee7-414d-856c-965691528384 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:39.523816 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-81fb5b9b-6ee7-414d-856c-965691528384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:39.591036 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1353/2696] 10.222.0.88 () {58 vars in 967 bytes} [Fri Aug 26 00:45:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:39.604567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:39.606003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:39.677551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78089e7-aa90-46b3-810b-dad5a47a2542 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:39.683246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbfeb2-1468-4981-8ed1-408da2fea5ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:39.683859 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfeb2-1468-4981-8ed1-408da2fea5ba service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:39.684140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfeb2-1468-4981-8ed1-408da2fea5ba service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:39.684412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbfeb2-1468-4981-8ed1-408da2fea5ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:39.693003 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbfeb2-1468-4981-8ed1-408da2fea5ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:39.694672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbfeb2-1468-4981-8ed1-408da2fea5ba service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:39.702728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1344/2697] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:45:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:45:41.376192 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5b9b-6ee7-414d-856c-965691528384 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:41.383567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:41.389708 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb5b9b-6ee7-414d-856c-965691528384 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:41.404777 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a464752-3054-45ef-8bd5-f202a6b57584 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:41.407193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a464752-3054-45ef-8bd5-f202a6b57584 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:41.407494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a464752-3054-45ef-8bd5-f202a6b57584 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:41.407761 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a464752-3054-45ef-8bd5-f202a6b57584 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:41.480086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a464752-3054-45ef-8bd5-f202a6b57584 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:41.481620 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a464752-3054-45ef-8bd5-f202a6b57584 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:41.491573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1354/2698] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:43.636016 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbfeb2-1468-4981-8ed1-408da2fea5ba service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:43.700137 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbfeb2-1468-4981-8ed1-408da2fea5ba service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:43.704863 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:43.705496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:43.705778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:43.706085 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] PATH_INFO: `/v3/users/b78b900895cc4c99bc5ab314ef32a19b` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:43.707252 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b78b900895cc4c99bc5ab314ef32a19b)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:43.709207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:43.758823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b78b900895cc4c99bc5ab314ef32a19b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:43.759508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b78b900895cc4c99bc5ab314ef32a19b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:43.766621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b78b900895cc4c99bc5ab314ef32a19b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:43.769061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:43.777025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b78b900895cc4c99bc5ab314ef32a19b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:43.790380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b78b900895cc4c99bc5ab314ef32a19b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:43.796410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1345/2699] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:43 2022] DELETE /identity/v3/users/b78b900895cc4c99bc5ab314ef32a19b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:43.801050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac901703-18b1-477d-80f0-2aa7b5d2d0c1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:43.801564 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac901703-18b1-477d-80f0-2aa7b5d2d0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:43.801688 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac901703-18b1-477d-80f0-2aa7b5d2d0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:43.821074 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ac901703-18b1-477d-80f0-2aa7b5d2d0c1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:43.822326 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ac901703-18b1-477d-80f0-2aa7b5d2d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:43.885617 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1355/2700] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:43.894851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:43.896431 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:43.956987 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2226173a-ffd9-43c3-9b43-23012f032a84 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:43.960968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2563f3-c675-4585-baff-f9ddf2cc1b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:43.961570 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2563f3-c675-4585-baff-f9ddf2cc1b4c service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:43.961850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2563f3-c675-4585-baff-f9ddf2cc1b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:43.962153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2563f3-c675-4585-baff-f9ddf2cc1b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:43.971157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2563f3-c675-4585-baff-f9ddf2cc1b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:43.972584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2563f3-c675-4585-baff-f9ddf2cc1b4c service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:43.982831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1346/2701] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:44.443483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac901703-18b1-477d-80f0-2aa7b5d2d0c1 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:44.445355 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ac901703-18b1-477d-80f0-2aa7b5d2d0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:44.457853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac901703-18b1-477d-80f0-2aa7b5d2d0c1 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:44.465090 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:44.465749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.466081 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.466381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] PATH_INFO: `/v3/projects/c6c189105f08400aa1b93c014d8e2f74` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.467621 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c189105f08400aa1b93c014d8e2f74)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:44.469542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:44.531965 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c189105f08400aa1b93c014d8e2f74', 'request_id': 'req-2ad00688-a812-412f-9f4f-224dc2a7b490'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.540261 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c189105f08400aa1b93c014d8e2f74', 'request_id': 'req-2ad00688-a812-412f-9f4f-224dc2a7b490'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.548368 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c189105f08400aa1b93c014d8e2f74', 'request_id': 'req-2ad00688-a812-412f-9f4f-224dc2a7b490'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.560140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] The token cache is being invalidate because project c6c189105f08400aa1b93c014d8e2f74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:44.560435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.561075 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.562669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1356/2702] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:44 2022] DELETE /identity/v3/projects/c6c189105f08400aa1b93c014d8e2f74 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:44.566564 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2563f3-c675-4585-baff-f9ddf2cc1b4c service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:44.576724 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2563f3-c675-4585-baff-f9ddf2cc1b4c service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:44.635089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:44.635722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:44.636007 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:44.636286 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] PATH_INFO: `/v3/users/bbdfdcd1e6044273a99ff8537d84d34e` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:44.637412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbdfdcd1e6044273a99ff8537d84d34e)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:44.639370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:44.685546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbdfdcd1e6044273a99ff8537d84d34e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.686135 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbdfdcd1e6044273a99ff8537d84d34e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.693609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbdfdcd1e6044273a99ff8537d84d34e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.701266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbdfdcd1e6044273a99ff8537d84d34e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.712947 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:44.714469 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbdfdcd1e6044273a99ff8537d84d34e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:44.722259 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1347/2703] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:44 2022] DELETE /identity/v3/users/bbdfdcd1e6044273a99ff8537d84d34e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:45.005618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.005618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:45.019855 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad00688-a812-412f-9f4f-224dc2a7b490 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.046809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:45.079804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.080441 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.080729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.081011 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] PATH_INFO: `/v3/projects/b6c03173ebfc4fd19fb89868acbc1d84` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.082166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c03173ebfc4fd19fb89868acbc1d84)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.084117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.130370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c03173ebfc4fd19fb89868acbc1d84', 'request_id': 'req-aaba3231-188b-4700-a469-d058a976e0c8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.136403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c03173ebfc4fd19fb89868acbc1d84', 'request_id': 'req-aaba3231-188b-4700-a469-d058a976e0c8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.143850 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c03173ebfc4fd19fb89868acbc1d84', 'request_id': 'req-aaba3231-188b-4700-a469-d058a976e0c8'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.154806 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] The token cache is being invalidate because project b6c03173ebfc4fd19fb89868acbc1d84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:45.155096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.155974 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.157460 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1357/2704] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:45 2022] DELETE /identity/v3/projects/b6c03173ebfc4fd19fb89868acbc1d84 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:45.161387 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.162817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:45.176170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5cda35-f088-4fce-9785-b7758fb60a0f admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.233584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.234261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.234545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.234822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] PATH_INFO: `/v3/users/366aa0a41ee94431bfdc505722462c38` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.235944 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] RBAC: Authorizing `identity:delete_user(user_id=366aa0a41ee94431bfdc505722462c38)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.237864 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.283229 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366aa0a41ee94431bfdc505722462c38'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.283893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366aa0a41ee94431bfdc505722462c38'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.292210 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366aa0a41ee94431bfdc505722462c38'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.299287 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366aa0a41ee94431bfdc505722462c38'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.311307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-e3388593-b681-4e7e-8461-1e5dd3e5788e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366aa0a41ee94431bfdc505722462c38'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.317246 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1348/2705] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:45:45 2022] DELETE /identity/v3/users/366aa0a41ee94431bfdc505722462c38 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:45.604470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.606747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:45.620650 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba3231-188b-4700-a469-d058a976e0c8 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.683284 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.684038 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.684385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.684733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] PATH_INFO: `/v3/projects/bc392464e61d46cf9c0df1f8260f1bb2` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.686248 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc392464e61d46cf9c0df1f8260f1bb2)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.688162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.737713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc392464e61d46cf9c0df1f8260f1bb2', 'request_id': 'req-72a0050e-2f04-483e-bcf1-aef1facbacde'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.745147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc392464e61d46cf9c0df1f8260f1bb2', 'request_id': 'req-72a0050e-2f04-483e-bcf1-aef1facbacde'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.751287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:45.755578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc392464e61d46cf9c0df1f8260f1bb2', 'request_id': 'req-72a0050e-2f04-483e-bcf1-aef1facbacde'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.768593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] The token cache is being invalidate because project bc392464e61d46cf9c0df1f8260f1bb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:45:45.768822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.769464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-72a0050e-2f04-483e-bcf1-aef1facbacde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:45:45.770970 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1358/2706] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:45:45 2022] DELETE /identity/v3/projects/bc392464e61d46cf9c0df1f8260f1bb2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:45:45.777355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fab66-e6bb-4624-9bb3-8ecbb658ba73 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.777841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fab66-e6bb-4624-9bb3-8ecbb658ba73 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.777841 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fab66-e6bb-4624-9bb3-8ecbb658ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.798157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-370fab66-e6bb-4624-9bb3-8ecbb658ba73 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:45.799379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-370fab66-e6bb-4624-9bb3-8ecbb658ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:45.862549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1349/2707] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:45.871692 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f132b-4369-459e-a72a-aedace196616 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.871976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f132b-4369-459e-a72a-aedace196616 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.872249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f132b-4369-459e-a72a-aedace196616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.892872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-cf2f132b-4369-459e-a72a-aedace196616 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:45.894281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-cf2f132b-4369-459e-a72a-aedace196616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:45.902699 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1359/2708] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:45.907308 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fab66-e6bb-4624-9bb3-8ecbb658ba73 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.917091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fab66-e6bb-4624-9bb3-8ecbb658ba73 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.922812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.923473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.923764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.924089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.924962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:45:45.925187 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.926871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.940761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1350/2709] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:45:45.945740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f132b-4369-459e-a72a-aedace196616 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:45.955448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f132b-4369-459e-a72a-aedace196616 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:45.960462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17df0-aeb5-48f3-84b2-635f00eae89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:45.961066 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17df0-aeb5-48f3-84b2-635f00eae89b admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:45.961351 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17df0-aeb5-48f3-84b2-635f00eae89b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:45.961627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17df0-aeb5-48f3-84b2-635f00eae89b admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:45.962289 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17df0-aeb5-48f3-84b2-635f00eae89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:45.964188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17df0-aeb5-48f3-84b2-635f00eae89b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:45.998653 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1360/2710] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:45:45 2022] POST /identity/v3/projects => generated 375 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:46.000117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.005601 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:46.013071 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4525e-c69a-4dd8-b753-abde35f6b0ea admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.075010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9d82a-8bbb-4955-b295-0bb5cad09b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.075651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9d82a-8bbb-4955-b295-0bb5cad09b7a admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.075938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9d82a-8bbb-4955-b295-0bb5cad09b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.076216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9d82a-8bbb-4955-b295-0bb5cad09b7a admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.076851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9d82a-8bbb-4955-b295-0bb5cad09b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.078808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9d82a-8bbb-4955-b295-0bb5cad09b7a admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.100965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1351/2711] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:45:45 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:45:46.105083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17df0-aeb5-48f3-84b2-635f00eae89b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.115516 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17df0-aeb5-48f3-84b2-635f00eae89b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.120976 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f855-5e9b-4d63-80e7-5661db56987b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.121600 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f855-5e9b-4d63-80e7-5661db56987b admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.121911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f855-5e9b-4d63-80e7-5661db56987b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.122194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152f855-5e9b-4d63-80e7-5661db56987b admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.122848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152f855-5e9b-4d63-80e7-5661db56987b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.124478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152f855-5e9b-4d63-80e7-5661db56987b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.136571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1361/2712] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:46.141585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9d82a-8bbb-4955-b295-0bb5cad09b7a admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.153103 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9d82a-8bbb-4955-b295-0bb5cad09b7a admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.158147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5852ee03-b3cb-49fe-883e-9ddc605ffff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.158747 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ee03-b3cb-49fe-883e-9ddc605ffff6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.159030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ee03-b3cb-49fe-883e-9ddc605ffff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.159335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5852ee03-b3cb-49fe-883e-9ddc605ffff6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.159981 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852ee03-b3cb-49fe-883e-9ddc605ffff6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.161586 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5852ee03-b3cb-49fe-883e-9ddc605ffff6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.172354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1352/2713] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:45:46.177252 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f855-5e9b-4d63-80e7-5661db56987b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.188179 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152f855-5e9b-4d63-80e7-5661db56987b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.193241 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.194004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.194914 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.196153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] PATH_INFO: `/v3/projects/c81a128fccce43d8b0a7522b9edd71b8/users/d7bc5ec11f9a4115b0962551963ed2a4/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.213200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c81a128fccce43d8b0a7522b9edd71b8, user_id=d7bc5ec11f9a4115b0962551963ed2a4, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.215920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.229794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1362/2714] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:45:46 2022] PUT /identity/v3/projects/c81a128fccce43d8b0a7522b9edd71b8/users/d7bc5ec11f9a4115b0962551963ed2a4/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:45:46.240961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498b29-70a1-4193-850d-40fe7cf593eb None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.241271 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498b29-70a1-4193-850d-40fe7cf593eb None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.241540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd498b29-70a1-4193-850d-40fe7cf593eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.274523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bd498b29-70a1-4193-850d-40fe7cf593eb None None] MFA Rules not processed for user `d7bc5ec11f9a4115b0962551963ed2a4`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:46.275731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bd498b29-70a1-4193-850d-40fe7cf593eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:46.343658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1353/2715] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:45:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:46.358347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:46.360149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:46.420394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf908d0-0d9c-4630-986f-b9e2f8f1fc26 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:46.424156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be2cb98356b4d628408d094589a83e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:46.424752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:46.425032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:46.425360 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:46.434431 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:46.435933 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:46.445239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1363/2716] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:45:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:45:47.181540 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63772e-c8d3-43b4-bc9f-31595be9d5c1 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:47.182060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63772e-c8d3-43b4-bc9f-31595be9d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:47.182360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c63772e-c8d3-43b4-bc9f-31595be9d5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:47.204898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5c63772e-c8d3-43b4-bc9f-31595be9d5c1 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:45:47.206138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5c63772e-c8d3-43b4-bc9f-31595be9d5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:47.264560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1354/2717] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:45:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:45:47.276924 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:45:47.278385 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:45:47.348387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28294f01-6461-487f-90d1-9442e742be64 service glance] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:45:47.354493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b291c62-a912-454b-a8f5-1c56bdd141dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:45:47.355103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291c62-a912-454b-a8f5-1c56bdd141dd service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:45:47.355403 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291c62-a912-454b-a8f5-1c56bdd141dd service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:45:47.355682 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b291c62-a912-454b-a8f5-1c56bdd141dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:45:47.363796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b291c62-a912-454b-a8f5-1c56bdd141dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:45:47.365380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b291c62-a912-454b-a8f5-1c56bdd141dd service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:45:47.373852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1364/2718] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:45:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:45:57.257759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:45:57.370645 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:06.354581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63772e-c8d3-43b4-bc9f-31595be9d5c1 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:06.434901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c63772e-c8d3-43b4-bc9f-31595be9d5c1 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:06.440582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:06.441226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:06.441506 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:06.441776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] PATH_INFO: `/v3/users/d7bc5ec11f9a4115b0962551963ed2a4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:06.442954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7bc5ec11f9a4115b0962551963ed2a4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:06.445664 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:06.500766 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7bc5ec11f9a4115b0962551963ed2a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:06.501603 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7bc5ec11f9a4115b0962551963ed2a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:06.510836 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7bc5ec11f9a4115b0962551963ed2a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:06.519373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7bc5ec11f9a4115b0962551963ed2a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:06.533843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7bc5ec11f9a4115b0962551963ed2a4'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:06.540843 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1355/2719] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:46:06 2022] DELETE /identity/v3/users/d7bc5ec11f9a4115b0962551963ed2a4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:06.545641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c65cbe-3634-43a4-9c6d-ed610306fcb5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:06.546196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c65cbe-3634-43a4-9c6d-ed610306fcb5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:06.546298 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c65cbe-3634-43a4-9c6d-ed610306fcb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:06.566796 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-10c65cbe-3634-43a4-9c6d-ed610306fcb5 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:06.568050 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-10c65cbe-3634-43a4-9c6d-ed610306fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:06.634581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1365/2720] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:06.644772 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:06.646291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:06.714565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706e4231-20aa-4e12-b08b-74731eccf8cc admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:06.719525 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c6920-dbd3-4243-947b-4e729474810e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:06.720150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6920-dbd3-4243-947b-4e729474810e service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:06.720432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6920-dbd3-4243-947b-4e729474810e service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:06.720760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c6920-dbd3-4243-947b-4e729474810e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:06.731596 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c6920-dbd3-4243-947b-4e729474810e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:06.733192 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c6920-dbd3-4243-947b-4e729474810e service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:06.744198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1356/2721] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:46:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:46:07.016713 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c65cbe-3634-43a4-9c6d-ed610306fcb5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.018194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-10c65cbe-3634-43a4-9c6d-ed610306fcb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:07.031521 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c65cbe-3634-43a4-9c6d-ed610306fcb5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.036386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.037162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.037452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.037725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] PATH_INFO: `/v3/projects/c81a128fccce43d8b0a7522b9edd71b8` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.039479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c81a128fccce43d8b0a7522b9edd71b8)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.041407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.088296 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c81a128fccce43d8b0a7522b9edd71b8', 'request_id': 'req-98d187b6-7cd9-4552-b20d-4f6c302fb480'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:07.094388 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c81a128fccce43d8b0a7522b9edd71b8', 'request_id': 'req-98d187b6-7cd9-4552-b20d-4f6c302fb480'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:07.101843 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c81a128fccce43d8b0a7522b9edd71b8', 'request_id': 'req-98d187b6-7cd9-4552-b20d-4f6c302fb480'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:07.112165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] The token cache is being invalidate because project c81a128fccce43d8b0a7522b9edd71b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:46:07.112456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:07.113078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-98d187b6-7cd9-4552-b20d-4f6c302fb480 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:07.114595 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1366/2722] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:46:07 2022] DELETE /identity/v3/projects/c81a128fccce43d8b0a7522b9edd71b8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:07.120373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9116ea-e71e-4342-8b2b-4fc3d4cf46ab None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.120662 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9116ea-e71e-4342-8b2b-4fc3d4cf46ab None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.121359 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9116ea-e71e-4342-8b2b-4fc3d4cf46ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.140640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-be9116ea-e71e-4342-8b2b-4fc3d4cf46ab None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:07.141848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-be9116ea-e71e-4342-8b2b-4fc3d4cf46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:07.160350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.206372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1357/2723] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:07.241442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa48a9-7468-4c4f-968c-436a6a7abd3f None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.242677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa48a9-7468-4c4f-968c-436a6a7abd3f None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.243135 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa48a9-7468-4c4f-968c-436a6a7abd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.264476 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-c0aa48a9-7468-4c4f-968c-436a6a7abd3f None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:07.265823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c0aa48a9-7468-4c4f-968c-436a6a7abd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:07.271470 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489981b-edac-428a-a14f-ee40079933b3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.271759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489981b-edac-428a-a14f-ee40079933b3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.272041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489981b-edac-428a-a14f-ee40079933b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.292354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-9489981b-edac-428a-a14f-ee40079933b3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:07.293565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9489981b-edac-428a-a14f-ee40079933b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:07.301680 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1358/2724] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:46:07.305696 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489981b-edac-428a-a14f-ee40079933b3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.314810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489981b-edac-428a-a14f-ee40079933b3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.319634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.321109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.321395 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.321674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.322350 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:07.322660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.324051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1367/2725] 10.222.0.88 () {58 vars in 967 bytes} [Fri Aug 26 00:46:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:07.324258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.339876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1359/2726] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:07.340059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa48a9-7468-4c4f-968c-436a6a7abd3f None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.340059 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c0aa48a9-7468-4c4f-968c-436a6a7abd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:07.341233 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.350882 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bebaec-471a-4e0a-b784-2bab240483a6 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.355684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c090-ab9f-49b4-a6cc-34f33c2a5dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.356290 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c090-ab9f-49b4-a6cc-34f33c2a5dbd admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.356552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c090-ab9f-49b4-a6cc-34f33c2a5dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.356808 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6c090-ab9f-49b4-a6cc-34f33c2a5dbd admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.357427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6c090-ab9f-49b4-a6cc-34f33c2a5dbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.359488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6c090-ab9f-49b4-a6cc-34f33c2a5dbd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.371048 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.388198 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1360/2727] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:46:07 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:46:07.392177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c090-ab9f-49b4-a6cc-34f33c2a5dbd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.414863 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa48a9-7468-4c4f-968c-436a6a7abd3f None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.457553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6c090-ab9f-49b4-a6cc-34f33c2a5dbd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.463191 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75270d-1067-4dc1-8f4d-9093743eab86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.463800 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75270d-1067-4dc1-8f4d-9093743eab86 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.464083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75270d-1067-4dc1-8f4d-9093743eab86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.464360 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75270d-1067-4dc1-8f4d-9093743eab86 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.464982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75270d-1067-4dc1-8f4d-9093743eab86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.466990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75270d-1067-4dc1-8f4d-9093743eab86 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.475588 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3197-3700-4572-a52e-bbf29ca4d234 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.476391 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3197-3700-4572-a52e-bbf29ca4d234 service swift] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.476877 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3197-3700-4572-a52e-bbf29ca4d234 service swift] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.477246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a3197-3700-4572-a52e-bbf29ca4d234 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.493200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1361/2728] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:46:07 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:46:07.494474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75270d-1067-4dc1-8f4d-9093743eab86 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.504261 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75270d-1067-4dc1-8f4d-9093743eab86 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.510279 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f073-7211-4e54-99b4-3ff76cd491bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.510870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f073-7211-4e54-99b4-3ff76cd491bb admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.511159 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f073-7211-4e54-99b4-3ff76cd491bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.511471 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0f073-7211-4e54-99b4-3ff76cd491bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.512114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f073-7211-4e54-99b4-3ff76cd491bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.513722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0f073-7211-4e54-99b4-3ff76cd491bb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.523988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1362/2729] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:46:07.527854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f073-7211-4e54-99b4-3ff76cd491bb admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.538010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3197-3700-4572-a52e-bbf29ca4d234 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.538211 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0f073-7211-4e54-99b4-3ff76cd491bb admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.539842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a3197-3700-4572-a52e-bbf29ca4d234 service swift] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.543143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f913e-0f6e-4aa3-8979-c5d01380aec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.543735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f913e-0f6e-4aa3-8979-c5d01380aec1 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.544020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f913e-0f6e-4aa3-8979-c5d01380aec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.544302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f913e-0f6e-4aa3-8979-c5d01380aec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.544930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f913e-0f6e-4aa3-8979-c5d01380aec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.546545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f913e-0f6e-4aa3-8979-c5d01380aec1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.549610 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1368/2730] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 26 00:46:07.560042 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1363/2731] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 26 00:46:07.563778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3197-3700-4572-a52e-bbf29ca4d234 service swift] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.575634 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a3197-3700-4572-a52e-bbf29ca4d234 service swift] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.585643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.586672 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.586962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.587244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] PATH_INFO: `/v3/projects/293a46e896d7420399a0dfe88d1c0c36/users/0fb63abe79d744c08ff7bb5f012d62f9/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.603111 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=293a46e896d7420399a0dfe88d1c0c36, user_id=0fb63abe79d744c08ff7bb5f012d62f9, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.605772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.620662 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1369/2732] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:46:07 2022] PUT /identity/v3/projects/293a46e896d7420399a0dfe88d1c0c36/users/0fb63abe79d744c08ff7bb5f012d62f9/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:07.630789 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e92fc-7794-45e4-bdd2-6bc6c7334cea None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.631138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e92fc-7794-45e4-bdd2-6bc6c7334cea None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.631476 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e92fc-7794-45e4-bdd2-6bc6c7334cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.664689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-400e92fc-7794-45e4-bdd2-6bc6c7334cea None None] MFA Rules not processed for user `0fb63abe79d744c08ff7bb5f012d62f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:07.666237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-400e92fc-7794-45e4-bdd2-6bc6c7334cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:07.710058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.740645 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1364/2733] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:07.751799 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:07.753492 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:07.814848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:07.819428 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbb9037-4162-45fa-8c27-f49f3dbaddd1 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:07.824879 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695f14-7ef2-438f-8844-d1ee5949a51e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:07.825498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695f14-7ef2-438f-8844-d1ee5949a51e service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:07.825785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695f14-7ef2-438f-8844-d1ee5949a51e service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:07.826121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3695f14-7ef2-438f-8844-d1ee5949a51e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:07.837384 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3695f14-7ef2-438f-8844-d1ee5949a51e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:07.838885 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3695f14-7ef2-438f-8844-d1ee5949a51e service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:07.848164 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1370/2734] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:46:07 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:46:09.511478 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e92fc-7794-45e4-bdd2-6bc6c7334cea None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:09.512945 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-400e92fc-7794-45e4-bdd2-6bc6c7334cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:09.583485 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e92fc-7794-45e4-bdd2-6bc6c7334cea None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:09.588432 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:09.589067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:09.589353 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:09.589634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] PATH_INFO: `/v3/users/21295fabeb1349a7a21d602fcbdbdf0a` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:09.590802 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=21295fabeb1349a7a21d602fcbdbdf0a)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:09.592744 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:09.639101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21295fabeb1349a7a21d602fcbdbdf0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:09.639758 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21295fabeb1349a7a21d602fcbdbdf0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:09.647182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21295fabeb1349a7a21d602fcbdbdf0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:09.655144 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21295fabeb1349a7a21d602fcbdbdf0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:09.667778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-91d51e93-8dce-45ec-a109-6c42dce72d7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21295fabeb1349a7a21d602fcbdbdf0a'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:09.673545 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1365/2735] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:46:09 2022] DELETE /identity/v3/users/21295fabeb1349a7a21d602fcbdbdf0a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:09.847120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695f14-7ef2-438f-8844-d1ee5949a51e service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:09.860954 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3695f14-7ef2-438f-8844-d1ee5949a51e service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:09.926956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:09.927590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:09.927878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:09.928159 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] PATH_INFO: `/v3/projects/947a9baf001d47f3baf57932af043143` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:09.929498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=947a9baf001d47f3baf57932af043143)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:09.931471 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:09.977676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '947a9baf001d47f3baf57932af043143', 'request_id': 'req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:09.983770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '947a9baf001d47f3baf57932af043143', 'request_id': 'req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:09.991216 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '947a9baf001d47f3baf57932af043143', 'request_id': 'req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:10.001725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] The token cache is being invalidate because project 947a9baf001d47f3baf57932af043143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:46:10.002057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:10.002698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-9cb5cc9a-cec2-4556-bdc2-8c5b64fe68d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:10.004161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1371/2736] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:46:09 2022] DELETE /identity/v3/projects/947a9baf001d47f3baf57932af043143 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:10.009725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffbb86-7654-40db-95d0-491c8a2fa956 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.010049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffbb86-7654-40db-95d0-491c8a2fa956 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.010331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffbb86-7654-40db-95d0-491c8a2fa956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.030806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bfffbb86-7654-40db-95d0-491c8a2fa956 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:10.032052 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bfffbb86-7654-40db-95d0-491c8a2fa956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:10.081183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:10.092626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1366/2737] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:10.100217 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d09d-ddf3-4176-836f-7dacb21f2225 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.100505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d09d-ddf3-4176-836f-7dacb21f2225 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.100782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4268d09d-ddf3-4176-836f-7dacb21f2225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.120318 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-4268d09d-ddf3-4176-836f-7dacb21f2225 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:10.121544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-4268d09d-ddf3-4176-836f-7dacb21f2225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:10.129370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1372/2738] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:10.134125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffbb86-7654-40db-95d0-491c8a2fa956 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.143651 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffbb86-7654-40db-95d0-491c8a2fa956 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.148956 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.149551 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.149830 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.150134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.150776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:10.151078 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.152670 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.164291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1367/2739] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 26 00:46:10.168456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d09d-ddf3-4176-836f-7dacb21f2225 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.177623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4268d09d-ddf3-4176-836f-7dacb21f2225 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.182675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d541d-64f9-4d88-9856-d2d1d6bd2e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.183264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d541d-64f9-4d88-9856-d2d1d6bd2e13 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.183546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d541d-64f9-4d88-9856-d2d1d6bd2e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.183823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d541d-64f9-4d88-9856-d2d1d6bd2e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.184453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d541d-64f9-4d88-9856-d2d1d6bd2e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.186417 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d541d-64f9-4d88-9856-d2d1d6bd2e13 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.216830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1373/2740] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:46:10 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:10.221041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.231114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751b267f-dd88-4e2d-bde5-8749d0784a39 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.285880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48facd74-6c79-45a6-985b-f135b4ec0c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.286498 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facd74-6c79-45a6-985b-f135b4ec0c37 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.286776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facd74-6c79-45a6-985b-f135b4ec0c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.287048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48facd74-6c79-45a6-985b-f135b4ec0c37 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.287658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48facd74-6c79-45a6-985b-f135b4ec0c37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.290244 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48facd74-6c79-45a6-985b-f135b4ec0c37 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.310885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1368/2741] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:46:10 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:10.314991 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d541d-64f9-4d88-9856-d2d1d6bd2e13 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.325433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d541d-64f9-4d88-9856-d2d1d6bd2e13 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.332760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c160c-5788-4c8c-8c87-8c9dc01a04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.333788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c160c-5788-4c8c-8c87-8c9dc01a04ba admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.334340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c160c-5788-4c8c-8c87-8c9dc01a04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.334852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c160c-5788-4c8c-8c87-8c9dc01a04ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.336051 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c160c-5788-4c8c-8c87-8c9dc01a04ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.339158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5c160c-5788-4c8c-8c87-8c9dc01a04ba admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.351953 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1374/2742] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:46:10.355765 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48facd74-6c79-45a6-985b-f135b4ec0c37 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.365750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48facd74-6c79-45a6-985b-f135b4ec0c37 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.371122 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeeeecc-3065-4a3e-8cf7-69765b0f8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.371725 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeeecc-3065-4a3e-8cf7-69765b0f8a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.372011 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeeecc-3065-4a3e-8cf7-69765b0f8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.372290 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeeeecc-3065-4a3e-8cf7-69765b0f8a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.372967 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeeecc-3065-4a3e-8cf7-69765b0f8a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.374634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeeeecc-3065-4a3e-8cf7-69765b0f8a67 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.385988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1369/2743] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:46:10.390225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c160c-5788-4c8c-8c87-8c9dc01a04ba admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.401132 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c160c-5788-4c8c-8c87-8c9dc01a04ba admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.406353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.407087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.407456 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.407801 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] PATH_INFO: `/v3/projects/e38e93e38dc042ffb1f24b7f4dd0f420/users/daecda4537f14bba95a24a241210c71d/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.423573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e38e93e38dc042ffb1f24b7f4dd0f420, user_id=daecda4537f14bba95a24a241210c71d, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.426345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.440649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1375/2744] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:46:10 2022] PUT /identity/v3/projects/e38e93e38dc042ffb1f24b7f4dd0f420/users/daecda4537f14bba95a24a241210c71d/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:10.451347 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822c6e-14e1-4288-843a-422cab6cc43a None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.451736 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822c6e-14e1-4288-843a-422cab6cc43a None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.451901 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57822c6e-14e1-4288-843a-422cab6cc43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.479580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-57822c6e-14e1-4288-843a-422cab6cc43a None None] MFA Rules not processed for user `daecda4537f14bba95a24a241210c71d`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:10.480812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-57822c6e-14e1-4288-843a-422cab6cc43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:10.558774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1370/2745] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:10.570587 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:10.572223 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:10.600260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:10.640859 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec5cc8-836a-4374-adf6-252a9b4e6144 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:10.644505 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655f31b-6bb3-4386-bf47-033432821e57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:10.645108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f31b-6bb3-4386-bf47-033432821e57 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:10.645392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f31b-6bb3-4386-bf47-033432821e57 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:10.645669 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655f31b-6bb3-4386-bf47-033432821e57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:10.654088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655f31b-6bb3-4386-bf47-033432821e57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:10.655765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655f31b-6bb3-4386-bf47-033432821e57 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:10.664735 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1376/2746] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:46:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:46:13.210828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57822c6e-14e1-4288-843a-422cab6cc43a None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:13.271483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:13.284991 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57822c6e-14e1-4288-843a-422cab6cc43a None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:13.290679 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:13.291324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:13.291614 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:13.291922 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] PATH_INFO: `/v3/users/daecda4537f14bba95a24a241210c71d` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:13.293115 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=daecda4537f14bba95a24a241210c71d)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:13.295143 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:13.346451 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daecda4537f14bba95a24a241210c71d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.347106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daecda4537f14bba95a24a241210c71d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.354973 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daecda4537f14bba95a24a241210c71d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.363512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daecda4537f14bba95a24a241210c71d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.377331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daecda4537f14bba95a24a241210c71d'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.383952 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1371/2747] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:46:13 2022] DELETE /identity/v3/users/daecda4537f14bba95a24a241210c71d => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:13.388511 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5801-1995-4390-a46f-02f215dc2e47 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:13.388995 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5801-1995-4390-a46f-02f215dc2e47 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:13.389102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb5801-1995-4390-a46f-02f215dc2e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:13.408449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-3ceb5801-1995-4390-a46f-02f215dc2e47 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:13.409647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ceb5801-1995-4390-a46f-02f215dc2e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:13.469148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1377/2748] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:46:13.479163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:13.480594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:13.543109 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703dfb1a-c1c5-4db6-a239-ecbcf027cd2d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:13.546959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad4bf0-5909-4f98-b26c-123bd700ded0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:13.547574 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad4bf0-5909-4f98-b26c-123bd700ded0 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:13.547862 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad4bf0-5909-4f98-b26c-123bd700ded0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:13.548140 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad4bf0-5909-4f98-b26c-123bd700ded0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:13.558655 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad4bf0-5909-4f98-b26c-123bd700ded0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:13.560114 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad4bf0-5909-4f98-b26c-123bd700ded0 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:13.571242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1372/2749] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:46:13.849846 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5801-1995-4390-a46f-02f215dc2e47 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:13.852444 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3ceb5801-1995-4390-a46f-02f215dc2e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:13.865578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb5801-1995-4390-a46f-02f215dc2e47 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:13.871721 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:13.872418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:13.872879 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:13.873166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] PATH_INFO: `/v3/projects/e38e93e38dc042ffb1f24b7f4dd0f420` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:13.874571 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e38e93e38dc042ffb1f24b7f4dd0f420)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:13.876912 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:13.929447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e38e93e38dc042ffb1f24b7f4dd0f420', 'request_id': 'req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.935959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e38e93e38dc042ffb1f24b7f4dd0f420', 'request_id': 'req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.943353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e38e93e38dc042ffb1f24b7f4dd0f420', 'request_id': 'req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.954383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] The token cache is being invalidate because project e38e93e38dc042ffb1f24b7f4dd0f420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:46:13.954679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.955381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-0a94f57b-4b8b-48bd-98e9-c3eb2c34249e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:13.956958 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1378/2750] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:46:13 2022] DELETE /identity/v3/projects/e38e93e38dc042ffb1f24b7f4dd0f420 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:13.962553 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b9976-22ce-4480-abd6-ed9288e0d0cf None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:13.962842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b9976-22ce-4480-abd6-ed9288e0d0cf None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:13.963139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b9976-22ce-4480-abd6-ed9288e0d0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:13.983241 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-200b9976-22ce-4480-abd6-ed9288e0d0cf None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:13.984442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-200b9976-22ce-4480-abd6-ed9288e0d0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:14.043613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1373/2751] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:14.052569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ea59-596f-49b2-8ce1-c0b77ec776a5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.052856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ea59-596f-49b2-8ce1-c0b77ec776a5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.053139 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82ea59-596f-49b2-8ce1-c0b77ec776a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.072520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-5b82ea59-596f-49b2-8ce1-c0b77ec776a5 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:14.073747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5b82ea59-596f-49b2-8ce1-c0b77ec776a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:14.081805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1379/2752] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:14.086398 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b9976-22ce-4480-abd6-ed9288e0d0cf None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.095996 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b9976-22ce-4480-abd6-ed9288e0d0cf None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.100523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.101685 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.101990 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.102270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.102918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:46:14.103226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.104823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.116113 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1374/2753] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:46:14.120283 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82ea59-596f-49b2-8ce1-c0b77ec776a5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.129437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82ea59-596f-49b2-8ce1-c0b77ec776a5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.134266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe1045-33b9-4720-acc4-6be01ef24be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.134856 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1045-33b9-4720-acc4-6be01ef24be9 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.135141 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1045-33b9-4720-acc4-6be01ef24be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.135418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe1045-33b9-4720-acc4-6be01ef24be9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.136065 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe1045-33b9-4720-acc4-6be01ef24be9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.137994 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe1045-33b9-4720-acc4-6be01ef24be9 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.167280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1380/2754] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:46:14 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:14.171408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.176573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:14.183362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44feca-8a86-4f35-813f-d0ff2bb51cbd admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.240061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03847-7155-4979-8903-b054b4925a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.240673 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03847-7155-4979-8903-b054b4925a72 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.240948 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03847-7155-4979-8903-b054b4925a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.241224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e03847-7155-4979-8903-b054b4925a72 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.241968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03847-7155-4979-8903-b054b4925a72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.243885 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e03847-7155-4979-8903-b054b4925a72 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.264815 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1375/2755] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:46:14 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:46:14.269108 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe1045-33b9-4720-acc4-6be01ef24be9 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.280499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe1045-33b9-4720-acc4-6be01ef24be9 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.285149 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25498af7-f8e7-45f1-90ab-4634a1e4cb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.285740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25498af7-f8e7-45f1-90ab-4634a1e4cb00 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.286068 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25498af7-f8e7-45f1-90ab-4634a1e4cb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.286340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25498af7-f8e7-45f1-90ab-4634a1e4cb00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.286989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25498af7-f8e7-45f1-90ab-4634a1e4cb00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.288703 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25498af7-f8e7-45f1-90ab-4634a1e4cb00 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.298544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1381/2756] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:46:14.302316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03847-7155-4979-8903-b054b4925a72 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.312618 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e03847-7155-4979-8903-b054b4925a72 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.317258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765d0a5-51c5-4d34-8228-1498cae250d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.317850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d0a5-51c5-4d34-8228-1498cae250d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.318167 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d0a5-51c5-4d34-8228-1498cae250d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.318443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765d0a5-51c5-4d34-8228-1498cae250d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.319087 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765d0a5-51c5-4d34-8228-1498cae250d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.321810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765d0a5-51c5-4d34-8228-1498cae250d8 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.332363 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1376/2757] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:46:14.337496 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25498af7-f8e7-45f1-90ab-4634a1e4cb00 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.343814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:14.348043 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25498af7-f8e7-45f1-90ab-4634a1e4cb00 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.354046 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.354840 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.355131 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.355409 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] PATH_INFO: `/v3/projects/a516c9fbb8cb452ca7f7ef8052e66436/users/6aea83ea6fd3401fbbb9075fda8a0c5a/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.369709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a516c9fbb8cb452ca7f7ef8052e66436, user_id=6aea83ea6fd3401fbbb9075fda8a0c5a, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.372400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.385986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1382/2758] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:46:14 2022] PUT /identity/v3/projects/a516c9fbb8cb452ca7f7ef8052e66436/users/6aea83ea6fd3401fbbb9075fda8a0c5a/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:14.396202 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979910-f4e5-4769-9c54-5e7c12142cfa None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.396494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979910-f4e5-4769-9c54-5e7c12142cfa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.396776 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11979910-f4e5-4769-9c54-5e7c12142cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.426352 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-11979910-f4e5-4769-9c54-5e7c12142cfa None None] MFA Rules not processed for user `6aea83ea6fd3401fbbb9075fda8a0c5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:14.427587 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-11979910-f4e5-4769-9c54-5e7c12142cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:14.492299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1377/2759] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:14.503530 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:14.505269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:14.564882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd47cc-76e7-473d-944b-c5d89777e629 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:14.568572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058950f1-d395-4f1f-b497-0b7501954cc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:14.569186 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058950f1-d395-4f1f-b497-0b7501954cc8 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:14.570193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058950f1-d395-4f1f-b497-0b7501954cc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:14.570577 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058950f1-d395-4f1f-b497-0b7501954cc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:14.580244 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058950f1-d395-4f1f-b497-0b7501954cc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:14.581701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058950f1-d395-4f1f-b497-0b7501954cc8 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:14.591270 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1383/2760] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:46:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:46:17.919422 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11979910-f4e5-4769-9c54-5e7c12142cfa None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:17.920904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-11979910-f4e5-4769-9c54-5e7c12142cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:17.987583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11979910-f4e5-4769-9c54-5e7c12142cfa None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:17.992217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:17.993346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:17.993634 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:17.993938 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] PATH_INFO: `/v3/users/0fb63abe79d744c08ff7bb5f012d62f9` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:17.995073 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fb63abe79d744c08ff7bb5f012d62f9)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:17.997010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:18.009847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:18.045704 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fb63abe79d744c08ff7bb5f012d62f9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.046394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fb63abe79d744c08ff7bb5f012d62f9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.054118 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fb63abe79d744c08ff7bb5f012d62f9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.061598 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fb63abe79d744c08ff7bb5f012d62f9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.074023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fb63abe79d744c08ff7bb5f012d62f9'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.079847 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1378/2761] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:46:17 2022] DELETE /identity/v3/users/0fb63abe79d744c08ff7bb5f012d62f9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:18.084332 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedd586-cb4f-451c-8d89-f67af1564398 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:18.084811 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedd586-cb4f-451c-8d89-f67af1564398 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:18.084909 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedd586-cb4f-451c-8d89-f67af1564398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:18.103353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bdedd586-cb4f-451c-8d89-f67af1564398 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:18.104558 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bdedd586-cb4f-451c-8d89-f67af1564398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:18.162494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1384/2762] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:18.172402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:18.173807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:18.231812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4c3dad-b7bb-4798-81c0-dd31f5a19d1e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:18.235524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c02e9b1-bde4-4591-a519-558c01eb96e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:18.236125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02e9b1-bde4-4591-a519-558c01eb96e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:18.236410 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02e9b1-bde4-4591-a519-558c01eb96e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:18.236684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c02e9b1-bde4-4591-a519-558c01eb96e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:18.246227 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02e9b1-bde4-4591-a519-558c01eb96e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:18.247857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c02e9b1-bde4-4591-a519-558c01eb96e9 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:18.257223 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1379/2763] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:46:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:46:18.535765 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedd586-cb4f-451c-8d89-f67af1564398 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:18.537423 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bdedd586-cb4f-451c-8d89-f67af1564398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:18.550814 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedd586-cb4f-451c-8d89-f67af1564398 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:18.560365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:18.561128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:18.561413 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:18.561700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] PATH_INFO: `/v3/projects/293a46e896d7420399a0dfe88d1c0c36` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:18.562997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=293a46e896d7420399a0dfe88d1c0c36)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:18.565091 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:18.612841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '293a46e896d7420399a0dfe88d1c0c36', 'request_id': 'req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.619412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '293a46e896d7420399a0dfe88d1c0c36', 'request_id': 'req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.626733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '293a46e896d7420399a0dfe88d1c0c36', 'request_id': 'req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.637639 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] The token cache is being invalidate because project 293a46e896d7420399a0dfe88d1c0c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:46:18.637957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.638597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:18.640084 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1385/2764] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:46:18 2022] DELETE /identity/v3/projects/293a46e896d7420399a0dfe88d1c0c36 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:28.253127 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=48,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:28.634327 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:29.059805 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f5b4d-ceed-47d3-acce-3e2904a58190 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:29.060092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f5b4d-ceed-47d3-acce-3e2904a58190 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:29.060374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447f5b4d-ceed-47d3-acce-3e2904a58190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:29.092509 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-447f5b4d-ceed-47d3-acce-3e2904a58190 None None] MFA Rules not processed for user `31c807a80aed45449a40029352a59aa5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:29.093646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-447f5b4d-ceed-47d3-acce-3e2904a58190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:29.168543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1380/2765] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:39.165667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=37 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:45.505208 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:45.506667 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:45.626684 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002cb5b0-5cbc-4131-b567-8bc0a85f0fb2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:45.631561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:45.632193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:45.632483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:45.632760 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] PATH_INFO: `/v3/users/6aea83ea6fd3401fbbb9075fda8a0c5a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:45.633923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aea83ea6fd3401fbbb9075fda8a0c5a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:45.636055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:45.681345 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aea83ea6fd3401fbbb9075fda8a0c5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:45.693438 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aea83ea6fd3401fbbb9075fda8a0c5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:45.694137 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aea83ea6fd3401fbbb9075fda8a0c5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:45.702268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aea83ea6fd3401fbbb9075fda8a0c5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:45.709649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aea83ea6fd3401fbbb9075fda8a0c5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:45.716173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1386/2766] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:46:45 2022] DELETE /identity/v3/users/6aea83ea6fd3401fbbb9075fda8a0c5a => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:45.720728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fae8f-de8f-4883-a7fb-fb3cebde2fd9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:45.721183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fae8f-de8f-4883-a7fb-fb3cebde2fd9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:45.721322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132fae8f-de8f-4883-a7fb-fb3cebde2fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:45.749275 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-132fae8f-de8f-4883-a7fb-fb3cebde2fd9 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:46:45.750466 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-132fae8f-de8f-4883-a7fb-fb3cebde2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:45.810285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1381/2767] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:46:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:46:45.820369 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:45.821785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:45.852093 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:45.896550 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bb8a28-c02f-4899-92e9-c620e3a39674 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:45.900262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c915751f-c3e8-455d-a59e-1af8b665b754 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:45.900872 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915751f-c3e8-455d-a59e-1af8b665b754 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:45.901705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915751f-c3e8-455d-a59e-1af8b665b754 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:45.902201 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c915751f-c3e8-455d-a59e-1af8b665b754 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:45.911575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915751f-c3e8-455d-a59e-1af8b665b754 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:45.913029 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c915751f-c3e8-455d-a59e-1af8b665b754 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:45.923150 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1387/2768] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:46:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:46:46.191490 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fae8f-de8f-4883-a7fb-fb3cebde2fd9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:46:46.193040 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-132fae8f-de8f-4883-a7fb-fb3cebde2fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:46:46.207212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132fae8f-de8f-4883-a7fb-fb3cebde2fd9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:46:46.212496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:46:46.213163 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:46:46.213447 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:46:46.214322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] PATH_INFO: `/v3/projects/a516c9fbb8cb452ca7f7ef8052e66436` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:46:46.215842 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a516c9fbb8cb452ca7f7ef8052e66436)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:46:46.217763 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:46:46.265590 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a516c9fbb8cb452ca7f7ef8052e66436', 'request_id': 'req-6caaafcb-e778-49a7-bdbc-c2755617f898'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:46.271419 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a516c9fbb8cb452ca7f7ef8052e66436', 'request_id': 'req-6caaafcb-e778-49a7-bdbc-c2755617f898'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:46.279537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a516c9fbb8cb452ca7f7ef8052e66436', 'request_id': 'req-6caaafcb-e778-49a7-bdbc-c2755617f898'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:46.290632 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] The token cache is being invalidate because project a516c9fbb8cb452ca7f7ef8052e66436 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:46:46.290924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:46.291566 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:46:46.293068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1382/2769] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:46:46 2022] DELETE /identity/v3/projects/a516c9fbb8cb452ca7f7ef8052e66436 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:46:55.919009 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=21 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:46:56.287606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:32.218183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31794022-e486-49cb-b57d-b7cebc3e0006 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:32.218734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31794022-e486-49cb-b57d-b7cebc3e0006 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:32.218734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31794022-e486-49cb-b57d-b7cebc3e0006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:32.248173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-31794022-e486-49cb-b57d-b7cebc3e0006 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:47:32.249394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-31794022-e486-49cb-b57d-b7cebc3e0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:32.311749 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1388/2770] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:47:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:47:32.358486 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:32.360069 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:32.432734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caaafcb-e778-49a7-bdbc-c2755617f898 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:32.437769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51cafd4-0230-474a-a633-f942d7ce6e5e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:32.438456 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cafd4-0230-474a-a633-f942d7ce6e5e service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:32.438803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cafd4-0230-474a-a633-f942d7ce6e5e service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:32.439081 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51cafd4-0230-474a-a633-f942d7ce6e5e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:32.450220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cafd4-0230-474a-a633-f942d7ce6e5e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:32.451962 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51cafd4-0230-474a-a633-f942d7ce6e5e service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:32.460510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1383/2771] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:47:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:47:40.774401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31794022-e486-49cb-b57d-b7cebc3e0006 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:40.777304 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-31794022-e486-49cb-b57d-b7cebc3e0006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:40.897420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31794022-e486-49cb-b57d-b7cebc3e0006 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:40.906198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1e0cd-4b29-49b8-a735-7c9f13cb84f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:40.907373 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e0cd-4b29-49b8-a735-7c9f13cb84f1 service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:40.908644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e0cd-4b29-49b8-a735-7c9f13cb84f1 service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:40.909262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1e0cd-4b29-49b8-a735-7c9f13cb84f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:40.911891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3aa1e0cd-4b29-49b8-a735-7c9f13cb84f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:40.925180 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1e0cd-4b29-49b8-a735-7c9f13cb84f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:40.927018 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1e0cd-4b29-49b8-a735-7c9f13cb84f1 service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:40.939118 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1389/2772] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:47:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:42.457030 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=32 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:46.652953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358831-fe56-4112-a097-e5d6397107ec None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:46.653658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358831-fe56-4112-a097-e5d6397107ec None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:46.653658 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e358831-fe56-4112-a097-e5d6397107ec None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:46.655047 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1384/2773] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:47:46.661433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca2ae-d176-451c-b3a1-329e33b499dd None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:46.661959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca2ae-d176-451c-b3a1-329e33b499dd None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:46.662072 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfca2ae-d176-451c-b3a1-329e33b499dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:46.704436 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-8bfca2ae-d176-451c-b3a1-329e33b499dd None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:47:46.705567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-8bfca2ae-d176-451c-b3a1-329e33b499dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:46.745740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:46.793387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1390/2774] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:47:46.804689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e358831-fe56-4112-a097-e5d6397107ec None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:46.806450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-7e358831-fe56-4112-a097-e5d6397107ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:46.866166 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e358831-fe56-4112-a097-e5d6397107ec None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:46.869695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103198a0-afaa-46ae-b50a-582543ff9c1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be2cb98356b4d628408d094589a83e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:46.871053 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103198a0-afaa-46ae-b50a-582543ff9c1a service glance] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:46.871334 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103198a0-afaa-46ae-b50a-582543ff9c1a service glance] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:46.871609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103198a0-afaa-46ae-b50a-582543ff9c1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:46.881889 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103198a0-afaa-46ae-b50a-582543ff9c1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:46.883333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103198a0-afaa-46ae-b50a-582543ff9c1a service glance] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:46.893965 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1385/2775] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:47:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:46.962905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a4d8d-cd85-4207-92f4-5d89a1a2a6c5 None None] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:46.963196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a4d8d-cd85-4207-92f4-5d89a1a2a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:46.963501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a4d8d-cd85-4207-92f4-5d89a1a2a6c5 None None] PATH_INFO: `/` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:46.965493 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1391/2776] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:47:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:47:46.970132 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ba5c6-887c-40ee-8d09-c8ba5ab1dba3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:46.970417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ba5c6-887c-40ee-8d09-c8ba5ab1dba3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:46.970691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ba5c6-887c-40ee-8d09-c8ba5ab1dba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:47.002310 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-103ba5c6-887c-40ee-8d09-c8ba5ab1dba3 None None] MFA Rules not processed for user `a0e9262597de4799a64977e44b41e6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:47:47.003521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-103ba5c6-887c-40ee-8d09-c8ba5ab1dba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:47.063642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1386/2777] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:47:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:47:47.075379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a4d8d-cd85-4207-92f4-5d89a1a2a6c5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:47.077144 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d17a4d8d-cd85-4207-92f4-5d89a1a2a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:47.091158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a4d8d-cd85-4207-92f4-5d89a1a2a6c5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:47.094709 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f174f0c8-fda5-43de-8fc0-c551f41ed796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:47.095300 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174f0c8-fda5-43de-8fc0-c551f41ed796 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:47.095584 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174f0c8-fda5-43de-8fc0-c551f41ed796 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:47.095864 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f174f0c8-fda5-43de-8fc0-c551f41ed796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:47.102862 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174f0c8-fda5-43de-8fc0-c551f41ed796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:47.104287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f174f0c8-fda5-43de-8fc0-c551f41ed796 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:47.112960 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1392/2778] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:47:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:47.196834 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfa8b1-7436-460a-bca1-47ca007101dd None None] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:47.197123 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfa8b1-7436-460a-bca1-47ca007101dd None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:47.197396 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bfa8b1-7436-460a-bca1-47ca007101dd None None] PATH_INFO: `/` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:47.198781 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1387/2779] 10.222.0.88 () {54 vars in 921 bytes} [Fri Aug 26 00:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 26 00:47:47.204061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78374-51d3-403d-b125-719ecb0c7a96 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:47.204350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78374-51d3-403d-b125-719ecb0c7a96 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:47.204628 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc78374-51d3-403d-b125-719ecb0c7a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:47.224370 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-6bc78374-51d3-403d-b125-719ecb0c7a96 None None] MFA Rules not processed for user `81ac50ea01de4a9d9b76befbcba88845`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:47:47.225509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-6bc78374-51d3-403d-b125-719ecb0c7a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:47.235447 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1393/2780] 10.222.0.88 () {58 vars in 1018 bytes} [Fri Aug 26 00:47:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:47:47.245943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfa8b1-7436-460a-bca1-47ca007101dd None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:47.257018 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bfa8b1-7436-460a-bca1-47ca007101dd None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:47.260555 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530a777-6201-4fc0-b17c-e21795e1f82b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:47.261335 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a777-6201-4fc0-b17c-e21795e1f82b service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:47.261617 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a777-6201-4fc0-b17c-e21795e1f82b service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:47.261912 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a777-6201-4fc0-b17c-e21795e1f82b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:47.271988 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530a777-6201-4fc0-b17c-e21795e1f82b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:47.273405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530a777-6201-4fc0-b17c-e21795e1f82b service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:47.284905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1388/2781] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:47:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:47:49.213841 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fd1a-bbdb-4b58-844e-1bbe580858d4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:49.214439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fd1a-bbdb-4b58-844e-1bbe580858d4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:49.214659 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6fd1a-bbdb-4b58-844e-1bbe580858d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:49.233437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-e9d6fd1a-bbdb-4b58-844e-1bbe580858d4 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:47:49.234693 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e9d6fd1a-bbdb-4b58-844e-1bbe580858d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:47:49.241915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1394/2782] 10.222.0.88 () {58 vars in 1009 bytes} [Fri Aug 26 00:47:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:47:49.254206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530a777-6201-4fc0-b17c-e21795e1f82b service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:47:49.266609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530a777-6201-4fc0-b17c-e21795e1f82b service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:47:49.271512 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a6a3-2b60-4edd-92a8-f65ebe2b0750 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:47:49.272101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a6a3-2b60-4edd-92a8-f65ebe2b0750 service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:47:49.272379 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a6a3-2b60-4edd-92a8-f65ebe2b0750 service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:47:49.272653 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf8a6a3-2b60-4edd-92a8-f65ebe2b0750 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:47:49.281527 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8a6a3-2b60-4edd-92a8-f65ebe2b0750 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:47:49.283146 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf8a6a3-2b60-4edd-92a8-f65ebe2b0750 service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:47:49.291063 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1389/2783] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:47:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:47:59.228641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=29 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:47:59.287890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=70 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:03.881097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a35da3-9749-4e81-a6d3-eebfac57a2d0 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:03.881599 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a35da3-9749-4e81-a6d3-eebfac57a2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:03.881701 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a35da3-9749-4e81-a6d3-eebfac57a2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:03.902585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-03a35da3-9749-4e81-a6d3-eebfac57a2d0 None None] MFA Rules not processed for user `902b00eca0fa4008b98205dfc26f4a6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:03.903829 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-03a35da3-9749-4e81-a6d3-eebfac57a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:03.911016 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1395/2784] 10.222.0.88 () {58 vars in 967 bytes} [Fri Aug 26 00:48:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:03.923501 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a6a3-2b60-4edd-92a8-f65ebe2b0750 service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:03.935086 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf8a6a3-2b60-4edd-92a8-f65ebe2b0750 service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:03.940235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbd16e-1002-4cf7-83ff-16d4a697b0fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c266ac5c785d46488a1a1560283ba4fa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:03.940822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbd16e-1002-4cf7-83ff-16d4a697b0fc service swift] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:03.941101 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbd16e-1002-4cf7-83ff-16d4a697b0fc service swift] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:03.941372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acbd16e-1002-4cf7-83ff-16d4a697b0fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:03.950272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbd16e-1002-4cf7-83ff-16d4a697b0fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:03.951848 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acbd16e-1002-4cf7-83ff-16d4a697b0fc service swift] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:03.959660 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1390/2785] 10.222.0.88 () {60 vars in 1384 bytes} [Fri Aug 26 00:48:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 26 00:48:13.896837 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:13.956504 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=6 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:37.482734 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a35da3-9749-4e81-a6d3-eebfac57a2d0 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:37.484156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-03a35da3-9749-4e81-a6d3-eebfac57a2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:37.560565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a35da3-9749-4e81-a6d3-eebfac57a2d0 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:37.564340 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:37.564955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:37.565242 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:37.565520 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:37.567317 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:37.624987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:37.626474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:37.635371 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1396/2786] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:48:37.974880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbd16e-1002-4cf7-83ff-16d4a697b0fc service swift] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:37.985373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acbd16e-1002-4cf7-83ff-16d4a697b0fc service swift] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:37.989031 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:37.989683 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:37.989950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:37.990235 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:37.991972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:38.005716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:38.007182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:38.018623 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1391/2787] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:48:39.200469 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:39.209996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41043724-d2cc-47bb-b263-291c28a21718 service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:39.213554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:39.214182 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:39.214467 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:39.214769 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:39.216491 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:39.229602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:39.231581 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:39.242483 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1397/2788] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:48:45.973489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:45.982473 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e534b2a4-94a7-4ba1-8d94-eef3b9c8c2b4 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:45.986185 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:45.986783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:45.987068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:45.987346 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:45.989147 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:46.052729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:46.054194 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:46.063999 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1392/2789] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:48:48.970495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:48.972033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:48.986969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c5315-0701-4a4c-88bb-eb6a5af465ff service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:48.991694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:48.992319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:48.992604 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:48.992879 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] PATH_INFO: `/v3/users/31c807a80aed45449a40029352a59aa5` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:48.994215 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c807a80aed45449a40029352a59aa5)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:48.996232 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:49.044996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c807a80aed45449a40029352a59aa5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.056726 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c807a80aed45449a40029352a59aa5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.057392 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c807a80aed45449a40029352a59aa5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.065206 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c807a80aed45449a40029352a59aa5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.069704 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:49.073762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-aadd773a-048a-4c3e-81d5-e8476c291cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c807a80aed45449a40029352a59aa5'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.081533 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1398/2790] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:48:48 2022] DELETE /identity/v3/users/31c807a80aed45449a40029352a59aa5 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:49.254998 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.270508 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aff6ad6-e22b-4c95-8861-bf784718cc53 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:49.329984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:49.330615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.330902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.331181 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] PATH_INFO: `/v3/projects/facd8d39b49144509f6859ee35b1d985` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.332305 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=facd8d39b49144509f6859ee35b1d985)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:49.334289 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:49.381020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'facd8d39b49144509f6859ee35b1d985', 'request_id': 'req-2d86733b-be7c-45eb-9638-38c59f45dd54'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.386691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'facd8d39b49144509f6859ee35b1d985', 'request_id': 'req-2d86733b-be7c-45eb-9638-38c59f45dd54'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.394429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'facd8d39b49144509f6859ee35b1d985', 'request_id': 'req-2d86733b-be7c-45eb-9638-38c59f45dd54'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.405820 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] The token cache is being invalidate because project facd8d39b49144509f6859ee35b1d985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:48:49.406149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.406790 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2d86733b-be7c-45eb-9638-38c59f45dd54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:49.408270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1393/2791] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:48:49 2022] DELETE /identity/v3/projects/facd8d39b49144509f6859ee35b1d985 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:49.413301 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587ec3e-cabb-4af3-bf24-826e006d249b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.413627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587ec3e-cabb-4af3-bf24-826e006d249b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.413985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587ec3e-cabb-4af3-bf24-826e006d249b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.453794 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-1587ec3e-cabb-4af3-bf24-826e006d249b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:49.455049 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1587ec3e-cabb-4af3-bf24-826e006d249b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:49.514513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1399/2792] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:49.523238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ec532-3558-426c-8f3b-343695139373 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.523526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ec532-3558-426c-8f3b-343695139373 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.523840 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097ec532-3558-426c-8f3b-343695139373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.544323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-097ec532-3558-426c-8f3b-343695139373 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:49.545537 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-097ec532-3558-426c-8f3b-343695139373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:49.553503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1394/2793] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:49.557896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587ec3e-cabb-4af3-bf24-826e006d249b None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.568238 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587ec3e-cabb-4af3-bf24-826e006d249b None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:49.572902 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:49.573498 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.573778 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.574083 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.574787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:49.575134 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:49.576907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:49.588195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1400/2794] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:48:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:49.592734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ec532-3558-426c-8f3b-343695139373 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.598557 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:49.602386 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097ec532-3558-426c-8f3b-343695139373 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:49.609004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbde6d4-3e43-466c-9d0e-f98210d666ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:49.609769 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbde6d4-3e43-466c-9d0e-f98210d666ac admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.610263 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbde6d4-3e43-466c-9d0e-f98210d666ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.610600 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbde6d4-3e43-466c-9d0e-f98210d666ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.611380 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbde6d4-3e43-466c-9d0e-f98210d666ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:49.613320 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbde6d4-3e43-466c-9d0e-f98210d666ac admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:49.651024 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1395/2795] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:48:49 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:49.655338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.665198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f7dfae-64df-42ef-8793-38b0bd28cff4 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:49.722968 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b55e3-87da-4861-bf94-0ec3d4aa7ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:49.723694 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b55e3-87da-4861-bf94-0ec3d4aa7ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.723980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b55e3-87da-4861-bf94-0ec3d4aa7ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.724254 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1b55e3-87da-4861-bf94-0ec3d4aa7ccd admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.724883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b55e3-87da-4861-bf94-0ec3d4aa7ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:49.726839 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1b55e3-87da-4861-bf94-0ec3d4aa7ccd admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:49.748980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1401/2796] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:48:49 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:49.753092 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbde6d4-3e43-466c-9d0e-f98210d666ac admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.763737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbde6d4-3e43-466c-9d0e-f98210d666ac admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:49.768391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a9b41-231d-450b-9648-a2942e00e6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:49.769017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a9b41-231d-450b-9648-a2942e00e6aa admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.769313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a9b41-231d-450b-9648-a2942e00e6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.769576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832a9b41-231d-450b-9648-a2942e00e6aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.770264 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a9b41-231d-450b-9648-a2942e00e6aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:49.771873 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832a9b41-231d-450b-9648-a2942e00e6aa admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:49.782080 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1396/2797] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:49.785951 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b55e3-87da-4861-bf94-0ec3d4aa7ccd admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.796744 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1b55e3-87da-4861-bf94-0ec3d4aa7ccd admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:49.801399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc12f3-9ce7-4eeb-9611-599afa9a4429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:49.802030 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc12f3-9ce7-4eeb-9611-599afa9a4429 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.802316 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc12f3-9ce7-4eeb-9611-599afa9a4429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.802590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc12f3-9ce7-4eeb-9611-599afa9a4429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.803234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc12f3-9ce7-4eeb-9611-599afa9a4429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:49.804852 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc12f3-9ce7-4eeb-9611-599afa9a4429 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:49.815433 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1402/2798] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:49.819461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a9b41-231d-450b-9648-a2942e00e6aa admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.829489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832a9b41-231d-450b-9648-a2942e00e6aa admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:49.834124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:49.834774 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.835060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.835339 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] PATH_INFO: `/v3/projects/127a6f2948774ec3a803c4a1686fb68c/users/0b58e4eb78804913bd613159d3805f7e/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.849698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] RBAC: Authorizing `identity:create_grant(project_id=127a6f2948774ec3a803c4a1686fb68c, user_id=0b58e4eb78804913bd613159d3805f7e, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:49.852399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:49.865584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1397/2799] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:49 2022] PUT /identity/v3/projects/127a6f2948774ec3a803c4a1686fb68c/users/0b58e4eb78804913bd613159d3805f7e/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:49.870579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed2be3-aa87-4093-9c50-5ec503b2f5b1 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:49.870896 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed2be3-aa87-4093-9c50-5ec503b2f5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:49.871787 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed2be3-aa87-4093-9c50-5ec503b2f5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:49.890747 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-38ed2be3-aa87-4093-9c50-5ec503b2f5b1 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:49.891957 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-38ed2be3-aa87-4093-9c50-5ec503b2f5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:49.931955 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:49.951808 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1403/2800] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:48:49.961358 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:49.963151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:50.019257 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64186e-cbb9-4044-93bd-496d820ef015 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.022871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24c713-b598-4283-b25f-9fb9d44de544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.023467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c713-b598-4283-b25f-9fb9d44de544 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.023749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c713-b598-4283-b25f-9fb9d44de544 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.024022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc24c713-b598-4283-b25f-9fb9d44de544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.033602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24c713-b598-4283-b25f-9fb9d44de544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.035059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc24c713-b598-4283-b25f-9fb9d44de544 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.045188 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1398/2801] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:48:50.677398 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650155e5-7a45-48bf-8f11-7c012b7cb568 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.677928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650155e5-7a45-48bf-8f11-7c012b7cb568 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.678195 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650155e5-7a45-48bf-8f11-7c012b7cb568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.708462 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-650155e5-7a45-48bf-8f11-7c012b7cb568 None None] MFA Rules not processed for user `0b58e4eb78804913bd613159d3805f7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:50.709707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-650155e5-7a45-48bf-8f11-7c012b7cb568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:50.781153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1404/2802] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:50.785787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24c713-b598-4283-b25f-9fb9d44de544 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.795811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc24c713-b598-4283-b25f-9fb9d44de544 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.800682 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd91c-f4d8-4056-8876-e230accc6137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.801278 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd91c-f4d8-4056-8876-e230accc6137 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.802270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd91c-f4d8-4056-8876-e230accc6137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.802562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd91c-f4d8-4056-8876-e230accc6137 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.803203 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffd91c-f4d8-4056-8876-e230accc6137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.805156 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fffd91c-f4d8-4056-8876-e230accc6137 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.836646 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1399/2803] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:48:50 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:50.837779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650155e5-7a45-48bf-8f11-7c012b7cb568 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.848915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650155e5-7a45-48bf-8f11-7c012b7cb568 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.907963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b988c0b-135a-4901-ae82-8045a92b3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.908578 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b988c0b-135a-4901-ae82-8045a92b3e38 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.908891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b988c0b-135a-4901-ae82-8045a92b3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.909194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b988c0b-135a-4901-ae82-8045a92b3e38 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.909832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b988c0b-135a-4901-ae82-8045a92b3e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.911782 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b988c0b-135a-4901-ae82-8045a92b3e38 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.932499 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1405/2804] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:48:50 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:48:50.937573 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd91c-f4d8-4056-8876-e230accc6137 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.947870 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd91c-f4d8-4056-8876-e230accc6137 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.953332 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0079f29-6928-432f-853a-4ff4a84ae1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.953939 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079f29-6928-432f-853a-4ff4a84ae1bf admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.954228 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079f29-6928-432f-853a-4ff4a84ae1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.954510 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0079f29-6928-432f-853a-4ff4a84ae1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:50.955155 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0079f29-6928-432f-853a-4ff4a84ae1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:50.956750 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0079f29-6928-432f-853a-4ff4a84ae1bf admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:50.967170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1400/2805] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:50.971328 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b988c0b-135a-4901-ae82-8045a92b3e38 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:50.982057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b988c0b-135a-4901-ae82-8045a92b3e38 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:50.986676 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219862-4919-4e63-974c-996b1844e83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:50.987350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219862-4919-4e63-974c-996b1844e83b admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:50.987636 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219862-4919-4e63-974c-996b1844e83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:50.987915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c219862-4919-4e63-974c-996b1844e83b admin admin] PATH_INFO: `/v3/projects/565ff1d3a61147838cc9d5d11a90e966/users/6925d08f665a48bba8dd30a792e97c32/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:51.003007 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219862-4919-4e63-974c-996b1844e83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=565ff1d3a61147838cc9d5d11a90e966, user_id=6925d08f665a48bba8dd30a792e97c32, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:51.005664 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c219862-4919-4e63-974c-996b1844e83b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.018510 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1406/2806] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:50 2022] PUT /identity/v3/projects/565ff1d3a61147838cc9d5d11a90e966/users/6925d08f665a48bba8dd30a792e97c32/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:51.022402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0079f29-6928-432f-853a-4ff4a84ae1bf admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:51.032524 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0079f29-6928-432f-853a-4ff4a84ae1bf admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:51.088767 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0b28a-15d3-44ec-b926-06d1b9b406e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:51.089402 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0b28a-15d3-44ec-b926-06d1b9b406e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:51.089686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0b28a-15d3-44ec-b926-06d1b9b406e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:51.090022 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0b28a-15d3-44ec-b926-06d1b9b406e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:51.090706 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0b28a-15d3-44ec-b926-06d1b9b406e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:51.092303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0b28a-15d3-44ec-b926-06d1b9b406e5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.101672 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1401/2807] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:51.106743 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219862-4919-4e63-974c-996b1844e83b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:51.116992 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c219862-4919-4e63-974c-996b1844e83b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:51.122331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:51.122983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:51.123266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:51.123545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] PATH_INFO: `/v3/projects/565ff1d3a61147838cc9d5d11a90e966/users/6925d08f665a48bba8dd30a792e97c32/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:51.125479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=565ff1d3a61147838cc9d5d11a90e966, user_id=6925d08f665a48bba8dd30a792e97c32, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:51.128153 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:51.138657 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1407/2808] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:51 2022] PUT /identity/v3/projects/565ff1d3a61147838cc9d5d11a90e966/users/6925d08f665a48bba8dd30a792e97c32/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:52.043686 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95ffd-315f-4cf4-8222-6cf4eeb70693 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:52.044328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95ffd-315f-4cf4-8222-6cf4eeb70693 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:52.044328 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c95ffd-315f-4cf4-8222-6cf4eeb70693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:52.052272 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:52.074206 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-03c95ffd-315f-4cf4-8222-6cf4eeb70693 None None] MFA Rules not processed for user `6925d08f665a48bba8dd30a792e97c32`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:52.075489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-03c95ffd-315f-4cf4-8222-6cf4eeb70693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:52.147207 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1402/2809] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:52.618427 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:52.620161 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:52.652399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:52.703250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfb6d9b-1bc6-4d30-8cb2-873ea4c9f2ef admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:52.708448 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:52.709061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:52.709350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:52.709627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:52.711400 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:52.724146 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:52.725752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:52.736454 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1408/2810] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:48:53.203307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c95ffd-315f-4cf4-8222-6cf4eeb70693 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:53.265661 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c95ffd-315f-4cf4-8222-6cf4eeb70693 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:53.270160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:53.270787 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:53.271068 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:53.271343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] PATH_INFO: `/v3/users/0b58e4eb78804913bd613159d3805f7e` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:53.272450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b58e4eb78804913bd613159d3805f7e)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:53.274407 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:53.320452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b58e4eb78804913bd613159d3805f7e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.321048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b58e4eb78804913bd613159d3805f7e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.328902 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b58e4eb78804913bd613159d3805f7e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.335796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b58e4eb78804913bd613159d3805f7e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.348242 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b58e4eb78804913bd613159d3805f7e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.354054 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1403/2811] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:48:53 2022] DELETE /identity/v3/users/0b58e4eb78804913bd613159d3805f7e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:53.526193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:53.538094 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193a0447-ea17-4393-b157-c520b3795ecc service placement] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:53.598209 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:53.598848 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:53.599133 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:53.599411 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] PATH_INFO: `/v3/projects/127a6f2948774ec3a803c4a1686fb68c` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:53.600539 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=127a6f2948774ec3a803c4a1686fb68c)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:53.602517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:53.648768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '127a6f2948774ec3a803c4a1686fb68c', 'request_id': 'req-f628a618-7ee9-4a74-ab41-eb08ec2becdb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.655268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '127a6f2948774ec3a803c4a1686fb68c', 'request_id': 'req-f628a618-7ee9-4a74-ab41-eb08ec2becdb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.662092 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '127a6f2948774ec3a803c4a1686fb68c', 'request_id': 'req-f628a618-7ee9-4a74-ab41-eb08ec2becdb'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.672429 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] The token cache is being invalidate because project 127a6f2948774ec3a803c4a1686fb68c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:48:53.672724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.673356 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.674854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1409/2812] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:48:53 2022] DELETE /identity/v3/projects/127a6f2948774ec3a803c4a1686fb68c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:53.678853 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:53.680281 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:53.693898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa816417-6204-4d23-92d2-e1f37e647d37 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:53.698726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:53.756149 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:53.756782 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:53.757060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:53.757333 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] PATH_INFO: `/v3/users/6925d08f665a48bba8dd30a792e97c32` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:53.758483 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6925d08f665a48bba8dd30a792e97c32)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:53.760409 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:53.808481 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6925d08f665a48bba8dd30a792e97c32'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.809226 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6925d08f665a48bba8dd30a792e97c32'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.816754 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6925d08f665a48bba8dd30a792e97c32'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.823642 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6925d08f665a48bba8dd30a792e97c32'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.835855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-66ae43af-e98c-4922-9e9d-9f45a1a94122 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6925d08f665a48bba8dd30a792e97c32'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:53.842106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1404/2813] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:48:53 2022] DELETE /identity/v3/users/6925d08f665a48bba8dd30a792e97c32 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:54.014045 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.015696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:54.031432 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628a618-7ee9-4a74-ab41-eb08ec2becdb admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.076061 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:54.089805 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.091117 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.091401 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.091679 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] PATH_INFO: `/v3/projects/565ff1d3a61147838cc9d5d11a90e966` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.092815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=565ff1d3a61147838cc9d5d11a90e966)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.094766 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.151234 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '565ff1d3a61147838cc9d5d11a90e966', 'request_id': 'req-7694c295-2518-4297-833a-654bb0ea8212'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:54.157935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '565ff1d3a61147838cc9d5d11a90e966', 'request_id': 'req-7694c295-2518-4297-833a-654bb0ea8212'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:54.165120 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '565ff1d3a61147838cc9d5d11a90e966', 'request_id': 'req-7694c295-2518-4297-833a-654bb0ea8212'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:54.175360 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] The token cache is being invalidate because project 565ff1d3a61147838cc9d5d11a90e966 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81540) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:48:54.175673 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:54.176294 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-7694c295-2518-4297-833a-654bb0ea8212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:54.177790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1410/2814] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:48:54 2022] DELETE /identity/v3/projects/565ff1d3a61147838cc9d5d11a90e966 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:54.182806 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd3b7-ccb2-4009-bd86-e5fab016c0e3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.183089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd3b7-ccb2-4009-bd86-e5fab016c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.183370 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183dd3b7-ccb2-4009-bd86-e5fab016c0e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.203393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-183dd3b7-ccb2-4009-bd86-e5fab016c0e3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:54.204643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-183dd3b7-ccb2-4009-bd86-e5fab016c0e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:54.265010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1405/2815] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:54.272790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34495d10-138c-4b90-a1da-31709f814aae None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.273074 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34495d10-138c-4b90-a1da-31709f814aae None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.273350 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34495d10-138c-4b90-a1da-31709f814aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.293562 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-34495d10-138c-4b90-a1da-31709f814aae None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:54.294786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-34495d10-138c-4b90-a1da-31709f814aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:54.302715 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1411/2816] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:54.306663 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dd3b7-ccb2-4009-bd86-e5fab016c0e3 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.316692 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183dd3b7-ccb2-4009-bd86-e5fab016c0e3 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.321365 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.321994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.322284 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.322560 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] PATH_INFO: `/v3/domains` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.323262 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81539) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:54.323571 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.326102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.337454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1406/2817] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:48:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:54.342154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34495d10-138c-4b90-a1da-31709f814aae None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.351247 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34495d10-138c-4b90-a1da-31709f814aae None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.355803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e633475-475a-47a6-b074-2391055f8777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.356382 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633475-475a-47a6-b074-2391055f8777 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.356661 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633475-475a-47a6-b074-2391055f8777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.356938 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e633475-475a-47a6-b074-2391055f8777 admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.357556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e633475-475a-47a6-b074-2391055f8777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.359473 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e633475-475a-47a6-b074-2391055f8777 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.387963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1412/2818] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:48:54 2022] POST /identity/v3/projects => generated 365 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:54.392219 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.402430 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab88c1-a1c8-4e19-b210-d12ac9b9e724 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.413833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:54.461608 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3c49-1b12-4853-b655-f4f58893b06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.462269 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3c49-1b12-4853-b655-f4f58893b06c admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.462554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3c49-1b12-4853-b655-f4f58893b06c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.462832 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbf3c49-1b12-4853-b655-f4f58893b06c admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.463460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3c49-1b12-4853-b655-f4f58893b06c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.465390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbf3c49-1b12-4853-b655-f4f58893b06c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.486880 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1407/2819] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:48:54 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:48:54.491020 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e633475-475a-47a6-b074-2391055f8777 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.503641 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e633475-475a-47a6-b074-2391055f8777 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.508390 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a58174-3e7d-4ad1-9f7d-f83c089eb539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.508984 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58174-3e7d-4ad1-9f7d-f83c089eb539 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.509268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58174-3e7d-4ad1-9f7d-f83c089eb539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.509544 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a58174-3e7d-4ad1-9f7d-f83c089eb539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.510218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a58174-3e7d-4ad1-9f7d-f83c089eb539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.512410 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a58174-3e7d-4ad1-9f7d-f83c089eb539 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.522424 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1413/2820] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:54.526708 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3c49-1b12-4853-b655-f4f58893b06c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.536909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbf3c49-1b12-4853-b655-f4f58893b06c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.541609 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4171ff04-3620-436c-91dc-9ad6e7fe58eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.542258 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ff04-3620-436c-91dc-9ad6e7fe58eb admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.542548 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ff04-3620-436c-91dc-9ad6e7fe58eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.542823 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4171ff04-3620-436c-91dc-9ad6e7fe58eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.543526 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ff04-3620-436c-91dc-9ad6e7fe58eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.545116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4171ff04-3620-436c-91dc-9ad6e7fe58eb admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.555796 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1408/2821] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:54.560762 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a58174-3e7d-4ad1-9f7d-f83c089eb539 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.570882 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a58174-3e7d-4ad1-9f7d-f83c089eb539 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.576933 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1111a-2100-413a-a563-3f493414126e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.577346 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1111a-2100-413a-a563-3f493414126e admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.577638 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1111a-2100-413a-a563-3f493414126e admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.577944 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c1111a-2100-413a-a563-3f493414126e admin admin] PATH_INFO: `/v3/projects/49b69fcf78c3475d89a85db5a3ac2513/users/bfd83e12ad3e4c749be1fce3a2955e5a/roles/e104332d9de24bed8d32257cab931633` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.592809 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1111a-2100-413a-a563-3f493414126e admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b69fcf78c3475d89a85db5a3ac2513, user_id=bfd83e12ad3e4c749be1fce3a2955e5a, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.595506 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c1111a-2100-413a-a563-3f493414126e admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.608198 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1414/2822] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:54 2022] PUT /identity/v3/projects/49b69fcf78c3475d89a85db5a3ac2513/users/bfd83e12ad3e4c749be1fce3a2955e5a/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:54.618488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9db9a-5185-4d61-b19c-25c5aa2071a7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.618778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9db9a-5185-4d61-b19c-25c5aa2071a7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.619058 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9db9a-5185-4d61-b19c-25c5aa2071a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.647454 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4ff9db9a-5185-4d61-b19c-25c5aa2071a7 None None] MFA Rules not processed for user `bfd83e12ad3e4c749be1fce3a2955e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:54.648707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4ff9db9a-5185-4d61-b19c-25c5aa2071a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:54.715076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1409/2823] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:54.719797 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1111a-2100-413a-a563-3f493414126e admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.781751 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c1111a-2100-413a-a563-3f493414126e admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.786554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c39b46-b1ca-4b58-9d3b-6145f126da7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.787162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39b46-b1ca-4b58-9d3b-6145f126da7a admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.787450 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39b46-b1ca-4b58-9d3b-6145f126da7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.787729 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c39b46-b1ca-4b58-9d3b-6145f126da7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.788365 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c39b46-b1ca-4b58-9d3b-6145f126da7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.790308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c39b46-b1ca-4b58-9d3b-6145f126da7a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.811183 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:54.819629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1415/2824] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:48:54 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:54.823674 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9db9a-5185-4d61-b19c-25c5aa2071a7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.834517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9db9a-5185-4d61-b19c-25c5aa2071a7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.889899 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f24bf-984c-4982-b217-24ea5c24ba98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.890503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f24bf-984c-4982-b217-24ea5c24ba98 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.890783 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f24bf-984c-4982-b217-24ea5c24ba98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.891056 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f24bf-984c-4982-b217-24ea5c24ba98 admin admin] PATH_INFO: `/v3/users` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.891668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f24bf-984c-4982-b217-24ea5c24ba98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.893581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f24bf-984c-4982-b217-24ea5c24ba98 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.913738 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1410/2825] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:48:54 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:54.917753 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c39b46-b1ca-4b58-9d3b-6145f126da7a admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.928925 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c39b46-b1ca-4b58-9d3b-6145f126da7a admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.933508 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619eb66-49ba-4055-8c57-cd501829f6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.934737 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619eb66-49ba-4055-8c57-cd501829f6dc admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.935039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619eb66-49ba-4055-8c57-cd501829f6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.935478 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619eb66-49ba-4055-8c57-cd501829f6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.935987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619eb66-49ba-4055-8c57-cd501829f6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.937575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619eb66-49ba-4055-8c57-cd501829f6dc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:54.948200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1416/2826] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:54.952467 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f24bf-984c-4982-b217-24ea5c24ba98 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:54.962199 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f24bf-984c-4982-b217-24ea5c24ba98 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:54.966803 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad4d26-c57e-495f-8a77-7c6e1a71fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:54.967443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad4d26-c57e-495f-8a77-7c6e1a71fbd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:54.967720 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad4d26-c57e-495f-8a77-7c6e1a71fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:54.967995 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad4d26-c57e-495f-8a77-7c6e1a71fbd3 admin admin] PATH_INFO: `/v3/projects/04b2d4bf0a76402f80ecbee0dcf6ea5d/users/3681490e322b41568251229d3ba6de65/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:54.981866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:54.984249 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad4d26-c57e-495f-8a77-7c6e1a71fbd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b2d4bf0a76402f80ecbee0dcf6ea5d, user_id=3681490e322b41568251229d3ba6de65, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:54.986887 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ad4d26-c57e-495f-8a77-7c6e1a71fbd3 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:55.000984 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1411/2827] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:54 2022] PUT /identity/v3/projects/04b2d4bf0a76402f80ecbee0dcf6ea5d/users/3681490e322b41568251229d3ba6de65/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:48:55.005032 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619eb66-49ba-4055-8c57-cd501829f6dc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:55.015257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619eb66-49ba-4055-8c57-cd501829f6dc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:55.070964 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e833c8-c591-4a1f-8668-5751079c2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:55.071590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e833c8-c591-4a1f-8668-5751079c2c7d admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:55.071869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e833c8-c591-4a1f-8668-5751079c2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:55.072138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e833c8-c591-4a1f-8668-5751079c2c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:55.072772 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e833c8-c591-4a1f-8668-5751079c2c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:55.074517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e833c8-c591-4a1f-8668-5751079c2c7d admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:55.084097 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1417/2828] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:55 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:55.088406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad4d26-c57e-495f-8a77-7c6e1a71fbd3 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:55.098797 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad4d26-c57e-495f-8a77-7c6e1a71fbd3 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:55.103356 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:55.104055 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:55.104344 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:55.104621 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] PATH_INFO: `/v3/projects/04b2d4bf0a76402f80ecbee0dcf6ea5d/users/3681490e322b41568251229d3ba6de65/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:55.107153 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b2d4bf0a76402f80ecbee0dcf6ea5d, user_id=3681490e322b41568251229d3ba6de65, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:55.109811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:55.119890 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1412/2829] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:55 2022] PUT /identity/v3/projects/04b2d4bf0a76402f80ecbee0dcf6ea5d/users/3681490e322b41568251229d3ba6de65/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:55.130988 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6fbcb-80c3-47d9-af10-3ef31648c5a5 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:55.131276 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6fbcb-80c3-47d9-af10-3ef31648c5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:55.131549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a6fbcb-80c3-47d9-af10-3ef31648c5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:55.160412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-20a6fbcb-80c3-47d9-af10-3ef31648c5a5 None None] MFA Rules not processed for user `3681490e322b41568251229d3ba6de65`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:55.161666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-20a6fbcb-80c3-47d9-af10-3ef31648c5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:55.228579 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1418/2830] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:55 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:55.240266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:55.242106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:55.300675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c20ece-1cfc-49c4-a608-c729f74da67d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:55.304507 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db9421d-7eeb-4932-be4f-dabedc5f8f7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:55.305148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9421d-7eeb-4932-be4f-dabedc5f8f7c service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:55.305434 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9421d-7eeb-4932-be4f-dabedc5f8f7c service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:55.305728 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db9421d-7eeb-4932-be4f-dabedc5f8f7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:55.314893 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9421d-7eeb-4932-be4f-dabedc5f8f7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:55.316330 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db9421d-7eeb-4932-be4f-dabedc5f8f7c service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:55.325930 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1413/2831] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:55 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:48:55.728575 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6fbcb-80c3-47d9-af10-3ef31648c5a5 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:55.791269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a6fbcb-80c3-47d9-af10-3ef31648c5a5 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:55.796102 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:55.796741 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:55.797027 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:55.797309 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] PATH_INFO: `/v3/users/bfd83e12ad3e4c749be1fce3a2955e5a` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:55.798480 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfd83e12ad3e4c749be1fce3a2955e5a)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:55.800725 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:55.811586 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=100 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:55.847418 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfd83e12ad3e4c749be1fce3a2955e5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:55.859308 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfd83e12ad3e4c749be1fce3a2955e5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:55.859962 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfd83e12ad3e4c749be1fce3a2955e5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:55.867281 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfd83e12ad3e4c749be1fce3a2955e5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:55.875088 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfd83e12ad3e4c749be1fce3a2955e5a'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:55.880913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1419/2832] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:48:55 2022] DELETE /identity/v3/users/bfd83e12ad3e4c749be1fce3a2955e5a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:55.885435 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581c378-8f11-4336-b93c-de1298fcec76 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:55.885726 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581c378-8f11-4336-b93c-de1298fcec76 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:55.886045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581c378-8f11-4336-b93c-de1298fcec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:55.905821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4581c378-8f11-4336-b93c-de1298fcec76 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:55.907082 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4581c378-8f11-4336-b93c-de1298fcec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:55.966154 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1414/2833] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:55.975738 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:55.977128 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:56.034376 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5160d81-bad5-4740-a879-fb7bde634712 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:56.038057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16fbf5-84c2-46fc-a636-b14aea1ddb4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:56.038660 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16fbf5-84c2-46fc-a636-b14aea1ddb4d service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:56.038947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16fbf5-84c2-46fc-a636-b14aea1ddb4d service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:56.039225 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16fbf5-84c2-46fc-a636-b14aea1ddb4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:56.048479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16fbf5-84c2-46fc-a636-b14aea1ddb4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:56.049928 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16fbf5-84c2-46fc-a636-b14aea1ddb4d service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:56.059932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1420/2834] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:48:56.326671 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581c378-8f11-4336-b93c-de1298fcec76 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:56.328174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4581c378-8f11-4336-b93c-de1298fcec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:56.342020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581c378-8f11-4336-b93c-de1298fcec76 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:56.346703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:56.347817 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:56.348160 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:56.348554 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] PATH_INFO: `/v3/projects/49b69fcf78c3475d89a85db5a3ac2513` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:56.349740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b69fcf78c3475d89a85db5a3ac2513)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:56.351650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:56.402237 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b69fcf78c3475d89a85db5a3ac2513', 'request_id': 'req-5b849f29-78f5-4d03-86df-a6bbff07ef9b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.407785 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b69fcf78c3475d89a85db5a3ac2513', 'request_id': 'req-5b849f29-78f5-4d03-86df-a6bbff07ef9b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.414925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b69fcf78c3475d89a85db5a3ac2513', 'request_id': 'req-5b849f29-78f5-4d03-86df-a6bbff07ef9b'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.426204 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] The token cache is being invalidate because project 49b69fcf78c3475d89a85db5a3ac2513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:48:56.426493 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.427131 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.428602 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1415/2835] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:48:56 2022] DELETE /identity/v3/projects/49b69fcf78c3475d89a85db5a3ac2513 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:48:56.432543 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16fbf5-84c2-46fc-a636-b14aea1ddb4d service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:56.442643 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16fbf5-84c2-46fc-a636-b14aea1ddb4d service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:56.499148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:56.499781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:56.500063 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:56.500337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] PATH_INFO: `/v3/users/3681490e322b41568251229d3ba6de65` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:56.501449 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3681490e322b41568251229d3ba6de65)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:56.503387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:56.537842 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:56.553453 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3681490e322b41568251229d3ba6de65'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.566501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3681490e322b41568251229d3ba6de65'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.567218 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3681490e322b41568251229d3ba6de65'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.574870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3681490e322b41568251229d3ba6de65'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.582055 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-3ca7b6fb-af04-45ed-bdbc-e6663567809f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3681490e322b41568251229d3ba6de65'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:56.587906 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1421/2836] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:48:56 2022] DELETE /identity/v3/users/3681490e322b41568251229d3ba6de65 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:56.863831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:56.865502 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:56.873911 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:56.880624 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b849f29-78f5-4d03-86df-a6bbff07ef9b admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:56.949060 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:56.949819 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:56.950138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:56.950416 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] PATH_INFO: `/v3/projects/04b2d4bf0a76402f80ecbee0dcf6ea5d` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:56.951549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b2d4bf0a76402f80ecbee0dcf6ea5d)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:56.953463 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.122405 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b2d4bf0a76402f80ecbee0dcf6ea5d', 'request_id': 'req-179ce717-b1d3-4789-8b36-b4478ac776a5'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:57.127731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b2d4bf0a76402f80ecbee0dcf6ea5d', 'request_id': 'req-179ce717-b1d3-4789-8b36-b4478ac776a5'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:57.134753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b2d4bf0a76402f80ecbee0dcf6ea5d', 'request_id': 'req-179ce717-b1d3-4789-8b36-b4478ac776a5'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:57.146212 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] The token cache is being invalidate because project 04b2d4bf0a76402f80ecbee0dcf6ea5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:48:57.146499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:57.147117 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-179ce717-b1d3-4789-8b36-b4478ac776a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:48:57.148576 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1416/2837] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:48:56 2022] DELETE /identity/v3/projects/04b2d4bf0a76402f80ecbee0dcf6ea5d => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:57.154352 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0307-5d4a-4057-9271-909cb6c9db26 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.154838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0307-5d4a-4057-9271-909cb6c9db26 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.154959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec0307-5d4a-4057-9271-909cb6c9db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.174830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-ceec0307-5d4a-4057-9271-909cb6c9db26 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:57.176049 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-ceec0307-5d4a-4057-9271-909cb6c9db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:57.236052 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1422/2838] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:57.244035 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3f06-d90f-4dfe-b28e-9b57d1af821b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.244327 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3f06-d90f-4dfe-b28e-9b57d1af821b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.244606 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fa3f06-d90f-4dfe-b28e-9b57d1af821b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.264388 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-57fa3f06-d90f-4dfe-b28e-9b57d1af821b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:57.265613 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-57fa3f06-d90f-4dfe-b28e-9b57d1af821b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:57.273691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1417/2839] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:57.279054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec0307-5d4a-4057-9271-909cb6c9db26 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.288853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec0307-5d4a-4057-9271-909cb6c9db26 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.293698 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.294347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.294635 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.294915 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.295598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:48:57.295908 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.297503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.308947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1423/2840] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:48:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:48:57.313205 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa3f06-d90f-4dfe-b28e-9b57d1af821b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.322390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fa3f06-d90f-4dfe-b28e-9b57d1af821b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.327594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194cc04-9c4e-46fd-a078-60ab7edf1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.328197 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194cc04-9c4e-46fd-a078-60ab7edf1b86 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.328450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194cc04-9c4e-46fd-a078-60ab7edf1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.328722 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194cc04-9c4e-46fd-a078-60ab7edf1b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.329367 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194cc04-9c4e-46fd-a078-60ab7edf1b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.331316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194cc04-9c4e-46fd-a078-60ab7edf1b86 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.358306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1418/2841] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:48:57 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:57.362545 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.373196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df1211-a567-42fb-9582-788e7026d51c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.432517 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfd1e2-299f-4485-a318-2368b7ab5441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.433115 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfd1e2-299f-4485-a318-2368b7ab5441 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.433395 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfd1e2-299f-4485-a318-2368b7ab5441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.434255 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdfd1e2-299f-4485-a318-2368b7ab5441 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.434973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfd1e2-299f-4485-a318-2368b7ab5441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.436907 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdfd1e2-299f-4485-a318-2368b7ab5441 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.458200 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1424/2842] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:48:57 2022] POST /identity/v3/users => generated 283 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:57.462436 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194cc04-9c4e-46fd-a078-60ab7edf1b86 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.473005 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194cc04-9c4e-46fd-a078-60ab7edf1b86 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.477713 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b9483-588a-4290-ba8c-d42667f6bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.478354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b9483-588a-4290-ba8c-d42667f6bca0 admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.478631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b9483-588a-4290-ba8c-d42667f6bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.478898 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b9483-588a-4290-ba8c-d42667f6bca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.479538 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b9483-588a-4290-ba8c-d42667f6bca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.481323 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b9483-588a-4290-ba8c-d42667f6bca0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.491125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1419/2843] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:57.494894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfd1e2-299f-4485-a318-2368b7ab5441 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.506193 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdfd1e2-299f-4485-a318-2368b7ab5441 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.514830 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4de4fb-96c7-4edf-858a-6f61308c78a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.515420 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de4fb-96c7-4edf-858a-6f61308c78a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.515700 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de4fb-96c7-4edf-858a-6f61308c78a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.519858 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4de4fb-96c7-4edf-858a-6f61308c78a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.520513 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4de4fb-96c7-4edf-858a-6f61308c78a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.522158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4de4fb-96c7-4edf-858a-6f61308c78a4 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.540430 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1425/2844] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:57.544650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b9483-588a-4290-ba8c-d42667f6bca0 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.555050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b9483-588a-4290-ba8c-d42667f6bca0 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.560584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0125a-5418-4bff-be0a-0406181fab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.561260 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0125a-5418-4bff-be0a-0406181fab7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.561546 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0125a-5418-4bff-be0a-0406181fab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.561824 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0125a-5418-4bff-be0a-0406181fab7c admin admin] PATH_INFO: `/v3/projects/fbfe692c079c4120bc4ccfbcd20cccfb/users/99103cdcb3b147068be805a007ca15be/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.577740 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0125a-5418-4bff-be0a-0406181fab7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbfe692c079c4120bc4ccfbcd20cccfb, user_id=99103cdcb3b147068be805a007ca15be, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.580397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0125a-5418-4bff-be0a-0406181fab7c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.593076 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1420/2845] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:57 2022] PUT /identity/v3/projects/fbfe692c079c4120bc4ccfbcd20cccfb/users/99103cdcb3b147068be805a007ca15be/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:57.603227 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d2af3-eb5f-433e-b9db-d6e7e4f7c7f4 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.603512 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d2af3-eb5f-433e-b9db-d6e7e4f7c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.603788 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769d2af3-eb5f-433e-b9db-d6e7e4f7c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.631752 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-769d2af3-eb5f-433e-b9db-d6e7e4f7c7f4 None None] MFA Rules not processed for user `99103cdcb3b147068be805a007ca15be`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:57.632947 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-769d2af3-eb5f-433e-b9db-d6e7e4f7c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:57.636823 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:57.699230 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1426/2846] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:57.704276 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0125a-5418-4bff-be0a-0406181fab7c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.734921 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:57.767640 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0125a-5418-4bff-be0a-0406181fab7c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.772224 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17a45-c34c-4e1b-90cc-e6e0046298af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.772822 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17a45-c34c-4e1b-90cc-e6e0046298af admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.773105 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17a45-c34c-4e1b-90cc-e6e0046298af admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.773377 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17a45-c34c-4e1b-90cc-e6e0046298af admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.774023 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17a45-c34c-4e1b-90cc-e6e0046298af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.776170 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17a45-c34c-4e1b-90cc-e6e0046298af admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.803381 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1421/2847] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:48:57 2022] POST /identity/v3/projects => generated 363 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:57.807495 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d2af3-eb5f-433e-b9db-d6e7e4f7c7f4 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.818798 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769d2af3-eb5f-433e-b9db-d6e7e4f7c7f4 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.874663 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f01ed-569c-4edf-a1a3-74a046a1a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.875262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f01ed-569c-4edf-a1a3-74a046a1a328 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.875546 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f01ed-569c-4edf-a1a3-74a046a1a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.875822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450f01ed-569c-4edf-a1a3-74a046a1a328 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.876442 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f01ed-569c-4edf-a1a3-74a046a1a328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.878394 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450f01ed-569c-4edf-a1a3-74a046a1a328 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.899313 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1427/2848] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:48:57 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:48:57.903821 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17a45-c34c-4e1b-90cc-e6e0046298af admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.914397 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17a45-c34c-4e1b-90cc-e6e0046298af admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.919849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af867a-09bc-4b08-8501-f3c5ce10d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.920477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af867a-09bc-4b08-8501-f3c5ce10d11c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.920764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af867a-09bc-4b08-8501-f3c5ce10d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.921051 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8af867a-09bc-4b08-8501-f3c5ce10d11c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.921700 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af867a-09bc-4b08-8501-f3c5ce10d11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.923354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8af867a-09bc-4b08-8501-f3c5ce10d11c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.933543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1422/2849] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:57.938570 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f01ed-569c-4edf-a1a3-74a046a1a328 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:57.948716 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450f01ed-569c-4edf-a1a3-74a046a1a328 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:57.953526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e532fe8-f55b-46b1-80dc-35ee507dc21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:57.954273 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532fe8-f55b-46b1-80dc-35ee507dc21b admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:57.954560 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532fe8-f55b-46b1-80dc-35ee507dc21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:57.954834 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e532fe8-f55b-46b1-80dc-35ee507dc21b admin admin] PATH_INFO: `/v3/projects/932654baeae14119b3b71576b4e151f4/users/68d9ffef2d044b59b1cf6380c0c11f74/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:57.969412 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e532fe8-f55b-46b1-80dc-35ee507dc21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=932654baeae14119b3b71576b4e151f4, user_id=68d9ffef2d044b59b1cf6380c0c11f74, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:57.972129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e532fe8-f55b-46b1-80dc-35ee507dc21b admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:57.985598 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1428/2850] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:57 2022] PUT /identity/v3/projects/932654baeae14119b3b71576b4e151f4/users/68d9ffef2d044b59b1cf6380c0c11f74/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:48:57.989707 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af867a-09bc-4b08-8501-f3c5ce10d11c admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:58.001089 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8af867a-09bc-4b08-8501-f3c5ce10d11c admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:58.057200 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5b6ed7-d321-4fed-8a70-8271d0caca9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:58.057734 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b6ed7-d321-4fed-8a70-8271d0caca9c admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:58.058049 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b6ed7-d321-4fed-8a70-8271d0caca9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:58.058324 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b6ed7-d321-4fed-8a70-8271d0caca9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:58.059691 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b6ed7-d321-4fed-8a70-8271d0caca9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:58.061484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5b6ed7-d321-4fed-8a70-8271d0caca9c admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:58.071126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1423/2851] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:48:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:48:58.075256 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e532fe8-f55b-46b1-80dc-35ee507dc21b admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:58.085503 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e532fe8-f55b-46b1-80dc-35ee507dc21b admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:58.090124 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:58.090770 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] REQUEST_METHOD: `PUT` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:58.091057 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:58.091338 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] PATH_INFO: `/v3/projects/932654baeae14119b3b71576b4e151f4/users/68d9ffef2d044b59b1cf6380c0c11f74/roles/f21c9b5697b747d39bf8f104797da245` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:58.093277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] RBAC: Authorizing `identity:create_grant(project_id=932654baeae14119b3b71576b4e151f4, user_id=68d9ffef2d044b59b1cf6380c0c11f74, role_id=f21c9b5697b747d39bf8f104797da245)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:58.095937 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:58.106529 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1429/2852] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:48:58 2022] PUT /identity/v3/projects/932654baeae14119b3b71576b4e151f4/users/68d9ffef2d044b59b1cf6380c0c11f74/roles/f21c9b5697b747d39bf8f104797da245 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:48:58.172094 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462be45-798f-483a-8a15-547581f875db None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:58.172378 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462be45-798f-483a-8a15-547581f875db None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:58.172657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d462be45-798f-483a-8a15-547581f875db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:58.200583 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-d462be45-798f-483a-8a15-547581f875db None None] MFA Rules not processed for user `68d9ffef2d044b59b1cf6380c0c11f74`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:48:58.201818 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-d462be45-798f-483a-8a15-547581f875db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:58.269752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1424/2853] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:48:58.282228 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:58.283920 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:48:58.342131 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8bbd4f-6ad6-4bee-90c9-6072d3da067f admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:58.345733 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e5a7a-d77f-42d6-a50c-c465dd6df77c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:58.346362 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e5a7a-d77f-42d6-a50c-c465dd6df77c service cinder] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:58.346649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e5a7a-d77f-42d6-a50c-c465dd6df77c service cinder] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:58.346927 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e5a7a-d77f-42d6-a50c-c465dd6df77c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:58.356559 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e5a7a-d77f-42d6-a50c-c465dd6df77c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:58.358025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e5a7a-d77f-42d6-a50c-c465dd6df77c service cinder] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:58.362972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:58.368166 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1430/2854] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:48:58.442677 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462be45-798f-483a-8a15-547581f875db None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:48:58.452391 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d462be45-798f-483a-8a15-547581f875db None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:48:58.456124 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc485ad0-a0b0-4902-b1d2-01a228fdb6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:48:58.456732 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485ad0-a0b0-4902-b1d2-01a228fdb6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:48:58.457017 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485ad0-a0b0-4902-b1d2-01a228fdb6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:48:58.457300 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc485ad0-a0b0-4902-b1d2-01a228fdb6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:48:58.478340 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:48:58.518290 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc485ad0-a0b0-4902-b1d2-01a228fdb6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:48:58.519735 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc485ad0-a0b0-4902-b1d2-01a228fdb6c1 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:48:58.529982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1425/2855] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:49:05.523437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e5a7a-d77f-42d6-a50c-c465dd6df77c service cinder] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:05.588348 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e5a7a-d77f-42d6-a50c-c465dd6df77c service cinder] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:05.593832 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:05.594489 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:05.594775 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:05.595079 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] PATH_INFO: `/v3/users/99103cdcb3b147068be805a007ca15be` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:05.596237 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=99103cdcb3b147068be805a007ca15be)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:05.598188 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:05.643956 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99103cdcb3b147068be805a007ca15be'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:05.656006 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99103cdcb3b147068be805a007ca15be'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:05.656666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99103cdcb3b147068be805a007ca15be'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:05.663730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99103cdcb3b147068be805a007ca15be'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:05.670932 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99103cdcb3b147068be805a007ca15be'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:05.676683 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1431/2856] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:49:05 2022] DELETE /identity/v3/users/99103cdcb3b147068be805a007ca15be => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:05.681247 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd767-6102-4a16-bda4-dc0e1959c5e9 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:05.681715 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd767-6102-4a16-bda4-dc0e1959c5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:05.681835 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfdd767-6102-4a16-bda4-dc0e1959c5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:05.700953 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-0dfdd767-6102-4a16-bda4-dc0e1959c5e9 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:05.702183 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0dfdd767-6102-4a16-bda4-dc0e1959c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:05.759150 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1426/2857] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:05.769623 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:05.771089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:05.828746 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac5baee-f905-49d1-a7fe-e8d398cb59ba admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:05.832380 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e9e79-9e29-4f51-928b-76c278fca429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:05.832981 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e9e79-9e29-4f51-928b-76c278fca429 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:05.833264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e9e79-9e29-4f51-928b-76c278fca429 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:05.833538 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8e9e79-9e29-4f51-928b-76c278fca429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:05.842455 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e9e79-9e29-4f51-928b-76c278fca429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:05.843879 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8e9e79-9e29-4f51-928b-76c278fca429 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:05.853162 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1432/2858] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:49:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:49:06.118045 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd767-6102-4a16-bda4-dc0e1959c5e9 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:06.119565 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-0dfdd767-6102-4a16-bda4-dc0e1959c5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:06.131562 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfdd767-6102-4a16-bda4-dc0e1959c5e9 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:06.136549 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:06.138059 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:06.138496 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:06.138935 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] PATH_INFO: `/v3/projects/fbfe692c079c4120bc4ccfbcd20cccfb` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:06.140157 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbfe692c079c4120bc4ccfbcd20cccfb)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:06.142303 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:06.189104 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbfe692c079c4120bc4ccfbcd20cccfb', 'request_id': 'req-2bc1efaf-806a-4897-b6db-a12ee58efe99'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.194807 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbfe692c079c4120bc4ccfbcd20cccfb', 'request_id': 'req-2bc1efaf-806a-4897-b6db-a12ee58efe99'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.202909 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbfe692c079c4120bc4ccfbcd20cccfb', 'request_id': 'req-2bc1efaf-806a-4897-b6db-a12ee58efe99'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.214151 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] The token cache is being invalidate because project fbfe692c079c4120bc4ccfbcd20cccfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:49:06.214442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.215899 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.217376 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1427/2859] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:49:06 2022] DELETE /identity/v3/projects/fbfe692c079c4120bc4ccfbcd20cccfb => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:49:06.221540 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e9e79-9e29-4f51-928b-76c278fca429 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:06.231334 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8e9e79-9e29-4f51-928b-76c278fca429 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:06.249759 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:06.291930 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:06.292556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:06.292838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:06.293126 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] PATH_INFO: `/v3/users/68d9ffef2d044b59b1cf6380c0c11f74` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:06.294435 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=68d9ffef2d044b59b1cf6380c0c11f74)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:06.296347 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:06.341381 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68d9ffef2d044b59b1cf6380c0c11f74'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.352790 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68d9ffef2d044b59b1cf6380c0c11f74'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.353440 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68d9ffef2d044b59b1cf6380c0c11f74'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.361086 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68d9ffef2d044b59b1cf6380c0c11f74'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.368269 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-521c77d0-9129-47ab-914e-0096f9f29d4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68d9ffef2d044b59b1cf6380c0c11f74'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.374873 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1433/2860] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:49:06 2022] DELETE /identity/v3/users/68d9ffef2d044b59b1cf6380c0c11f74 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:06.650866 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:06.652361 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:06.667319 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1efaf-806a-4897-b6db-a12ee58efe99 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:06.712594 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:06.726978 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:06.727528 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:06.727809 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:06.728083 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] PATH_INFO: `/v3/projects/932654baeae14119b3b71576b4e151f4` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:06.729195 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=932654baeae14119b3b71576b4e151f4)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:06.731778 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:06.776854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '932654baeae14119b3b71576b4e151f4', 'request_id': 'req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.782918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '932654baeae14119b3b71576b4e151f4', 'request_id': 'req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.790178 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '932654baeae14119b3b71576b4e151f4', 'request_id': 'req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.801306 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] The token cache is being invalidate because project 932654baeae14119b3b71576b4e151f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:49:06.801597 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.802270 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-4f2ab8fb-40b7-44ad-9f31-289e2a92a1b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:06.803759 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1428/2861] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:49:06 2022] DELETE /identity/v3/projects/932654baeae14119b3b71576b4e151f4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:06.809501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134a7e-a4ba-4f58-aec3-fdf4f47d00b9 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:06.810037 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134a7e-a4ba-4f58-aec3-fdf4f47d00b9 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:06.810154 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4134a7e-a4ba-4f58-aec3-fdf4f47d00b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:06.830114 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-d4134a7e-a4ba-4f58-aec3-fdf4f47d00b9 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:06.831357 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-d4134a7e-a4ba-4f58-aec3-fdf4f47d00b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:06.889515 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1434/2862] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:06.897517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7704af-ecc3-41f0-bd9d-d9673543f403 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:06.897942 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7704af-ecc3-41f0-bd9d-d9673543f403 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:06.898234 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7704af-ecc3-41f0-bd9d-d9673543f403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:06.921669 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-5a7704af-ecc3-41f0-bd9d-d9673543f403 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:06.922940 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-5a7704af-ecc3-41f0-bd9d-d9673543f403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:06.931010 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1429/2863] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:06.935378 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4134a7e-a4ba-4f58-aec3-fdf4f47d00b9 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:06.945786 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4134a7e-a4ba-4f58-aec3-fdf4f47d00b9 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:06.950979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:06.951572 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:06.951854 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:06.952129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:06.952781 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:06.953087 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:06.954719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:06.966822 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1435/2864] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:49:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:06.971341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7704af-ecc3-41f0-bd9d-d9673543f403 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:06.981004 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7704af-ecc3-41f0-bd9d-d9673543f403 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:06.985675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8679608-8262-4f9b-a34b-03e4ad3af4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:06.986302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679608-8262-4f9b-a34b-03e4ad3af4fa admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:06.986584 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679608-8262-4f9b-a34b-03e4ad3af4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:06.986856 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8679608-8262-4f9b-a34b-03e4ad3af4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:06.987489 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8679608-8262-4f9b-a34b-03e4ad3af4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:06.989383 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8679608-8262-4f9b-a34b-03e4ad3af4fa admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:07.016285 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1430/2865] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:49:06 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:07.020353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:07.031260 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa52031-c585-4c05-a93e-34e629490844 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:07.056618 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:07.088836 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b1093-12a5-41f7-966f-1218cfc56314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:07.089434 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b1093-12a5-41f7-966f-1218cfc56314 admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.089714 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b1093-12a5-41f7-966f-1218cfc56314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.090605 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b1093-12a5-41f7-966f-1218cfc56314 admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.091386 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b1093-12a5-41f7-966f-1218cfc56314 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:07.093279 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b1093-12a5-41f7-966f-1218cfc56314 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:07.114240 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1436/2866] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:49:07 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:07.118408 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8679608-8262-4f9b-a34b-03e4ad3af4fa admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:07.129752 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8679608-8262-4f9b-a34b-03e4ad3af4fa admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:07.134499 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f8360-9c4b-460e-8da9-8dc45609da5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:07.135139 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f8360-9c4b-460e-8da9-8dc45609da5e admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.135457 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f8360-9c4b-460e-8da9-8dc45609da5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.135761 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f8360-9c4b-460e-8da9-8dc45609da5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.136443 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f8360-9c4b-460e-8da9-8dc45609da5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:07.138876 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f8360-9c4b-460e-8da9-8dc45609da5e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:07.148812 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1431/2867] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:49:07.152963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b1093-12a5-41f7-966f-1218cfc56314 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:07.162812 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b1093-12a5-41f7-966f-1218cfc56314 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:07.167402 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b887756-38cd-4880-9803-8b10c45efbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:07.167983 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887756-38cd-4880-9803-8b10c45efbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.168303 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887756-38cd-4880-9803-8b10c45efbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.168569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887756-38cd-4880-9803-8b10c45efbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.169259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b887756-38cd-4880-9803-8b10c45efbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:07.170891 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b887756-38cd-4880-9803-8b10c45efbf0 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:07.180477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1437/2868] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:49:07.185372 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f8360-9c4b-460e-8da9-8dc45609da5e admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:07.195406 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f8360-9c4b-460e-8da9-8dc45609da5e admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:07.200937 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:07.201585 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.201972 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.202189 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] PATH_INFO: `/v3/projects/2cb81de195ef47c8b749684784cf2a31/users/499e32a69b7e47289b69b669896047fc/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.216668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb81de195ef47c8b749684784cf2a31, user_id=499e32a69b7e47289b69b669896047fc, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:07.219427 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:07.232091 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1432/2869] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:49:07 2022] PUT /identity/v3/projects/2cb81de195ef47c8b749684784cf2a31/users/499e32a69b7e47289b69b669896047fc/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:07.242445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5304b-f6e6-40da-9897-a7e4d286f4ee None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.242804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5304b-f6e6-40da-9897-a7e4d286f4ee None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.243148 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5304b-f6e6-40da-9897-a7e4d286f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.272249 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-48e5304b-f6e6-40da-9897-a7e4d286f4ee None None] MFA Rules not processed for user `499e32a69b7e47289b69b669896047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:07.273490 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-48e5304b-f6e6-40da-9897-a7e4d286f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:07.338691 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1438/2870] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:07.350851 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:07.352520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:07.409641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3415188-4cb6-4bbc-b938-34a319146ac5 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:07.413299 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bbf863-147e-4e6f-94e2-07579bac6e00 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be2cb98356b4d628408d094589a83e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:07.413924 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbf863-147e-4e6f-94e2-07579bac6e00 service glance] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:07.414216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbf863-147e-4e6f-94e2-07579bac6e00 service glance] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:07.414484 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bbf863-147e-4e6f-94e2-07579bac6e00 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:07.422569 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbf863-147e-4e6f-94e2-07579bac6e00 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:07.423994 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bbf863-147e-4e6f-94e2-07579bac6e00 service glance] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:07.432556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1433/2871] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:49:17.335710 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:17.428741 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:29.957919 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5304b-f6e6-40da-9897-a7e4d286f4ee None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.020541 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5304b-f6e6-40da-9897-a7e4d286f4ee None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.025085 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.025993 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.026277 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.026552 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] PATH_INFO: `/v3/users/499e32a69b7e47289b69b669896047fc` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.027675 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499e32a69b7e47289b69b669896047fc)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.030147 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.077039 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499e32a69b7e47289b69b669896047fc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.088831 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499e32a69b7e47289b69b669896047fc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.089502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499e32a69b7e47289b69b669896047fc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.097165 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499e32a69b7e47289b69b669896047fc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.104025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499e32a69b7e47289b69b669896047fc'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.110479 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1439/2872] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:49:29 2022] DELETE /identity/v3/users/499e32a69b7e47289b69b669896047fc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:30.115025 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0cba-3351-4018-b64f-492dae9fa999 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.115518 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0cba-3351-4018-b64f-492dae9fa999 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.115626 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab0cba-3351-4018-b64f-492dae9fa999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.134488 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4bab0cba-3351-4018-b64f-492dae9fa999 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:30.135684 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4bab0cba-3351-4018-b64f-492dae9fa999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:30.193749 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1434/2873] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:30.204554 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.205985 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:30.263280 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85814fbe-285a-476d-b8bf-5c8719c8e334 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.267103 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536a178-df83-490f-9c8a-ac66475f279e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.267707 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a178-df83-490f-9c8a-ac66475f279e service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.267989 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a178-df83-490f-9c8a-ac66475f279e service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.268265 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536a178-df83-490f-9c8a-ac66475f279e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.277439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a178-df83-490f-9c8a-ac66475f279e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.279407 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536a178-df83-490f-9c8a-ac66475f279e service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.289477 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1440/2874] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:49:30.565552 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab0cba-3351-4018-b64f-492dae9fa999 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.567020 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4bab0cba-3351-4018-b64f-492dae9fa999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:30.582084 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab0cba-3351-4018-b64f-492dae9fa999 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.586792 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.587428 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.588232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.588543 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] PATH_INFO: `/v3/projects/2cb81de195ef47c8b749684784cf2a31` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.589925 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb81de195ef47c8b749684784cf2a31)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.592695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.640918 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb81de195ef47c8b749684784cf2a31', 'request_id': 'req-34db7e80-9e46-44f9-9b78-05dcf3024ee0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.646460 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb81de195ef47c8b749684784cf2a31', 'request_id': 'req-34db7e80-9e46-44f9-9b78-05dcf3024ee0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.654475 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb81de195ef47c8b749684784cf2a31', 'request_id': 'req-34db7e80-9e46-44f9-9b78-05dcf3024ee0'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.665437 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] The token cache is being invalidate because project 2cb81de195ef47c8b749684784cf2a31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:49:30.665731 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.666399 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-34db7e80-9e46-44f9-9b78-05dcf3024ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:49:30.667871 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1435/2875] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:49:30 2022] DELETE /identity/v3/projects/2cb81de195ef47c8b749684784cf2a31 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:49:30.673271 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b258-be7c-4dbc-a0e8-a5488f0b5646 None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.673566 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b258-be7c-4dbc-a0e8-a5488f0b5646 None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.673844 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68b258-be7c-4dbc-a0e8-a5488f0b5646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.693329 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-bc68b258-be7c-4dbc-a0e8-a5488f0b5646 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:30.694594 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-bc68b258-be7c-4dbc-a0e8-a5488f0b5646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:30.711262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:30.757484 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1441/2876] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:30.765801 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f893fa-259c-40a6-ac7c-cfb8429d60d7 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.766142 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f893fa-259c-40a6-ac7c-cfb8429d60d7 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.766417 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f893fa-259c-40a6-ac7c-cfb8429d60d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.786392 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-f5f893fa-259c-40a6-ac7c-cfb8429d60d7 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:30.787914 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-f5f893fa-259c-40a6-ac7c-cfb8429d60d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:30.796106 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1436/2877] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:30.800236 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68b258-be7c-4dbc-a0e8-a5488f0b5646 None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.810121 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc68b258-be7c-4dbc-a0e8-a5488f0b5646 None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.814731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.815325 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.815647 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.815943 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.816602 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81540) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 26 00:49:30.816911 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.818589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.830437 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1442/2878] 10.222.0.88 () {58 vars in 1153 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 26 00:49:30.834716 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f893fa-259c-40a6-ac7c-cfb8429d60d7 None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.844511 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f893fa-259c-40a6-ac7c-cfb8429d60d7 None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.849164 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98dc36-a852-432d-a3fb-16c6e5b2b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.849753 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98dc36-a852-432d-a3fb-16c6e5b2b363 admin admin] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.850065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98dc36-a852-432d-a3fb-16c6e5b2b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.850343 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98dc36-a852-432d-a3fb-16c6e5b2b363 admin admin] PATH_INFO: `/v3/projects` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.850958 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98dc36-a852-432d-a3fb-16c6e5b2b363 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.852849 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98dc36-a852-432d-a3fb-16c6e5b2b363 admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.879521 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1437/2879] 10.222.0.88 () {60 vars in 1153 bytes} [Fri Aug 26 00:49:30 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 26 00:49:30.883767 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.894526 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49212d6d-a66d-4363-8dc4-f567fd9935b2 admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.950250 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9cf3b-55f8-4b55-b2ea-7146a011c40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.951487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9cf3b-55f8-4b55-b2ea-7146a011c40c admin admin] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.951815 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9cf3b-55f8-4b55-b2ea-7146a011c40c admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.952109 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9cf3b-55f8-4b55-b2ea-7146a011c40c admin admin] PATH_INFO: `/v3/users` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.952730 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9cf3b-55f8-4b55-b2ea-7146a011c40c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.954677 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9cf3b-55f8-4b55-b2ea-7146a011c40c admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:30.975219 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1443/2880] 10.222.0.88 () {60 vars in 1144 bytes} [Fri Aug 26 00:49:30 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 26 00:49:30.979480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98dc36-a852-432d-a3fb-16c6e5b2b363 admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:30.989833 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98dc36-a852-432d-a3fb-16c6e5b2b363 admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:30.994355 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cd29f-28f5-473f-aeb2-0968010b886d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:30.994943 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd29f-28f5-473f-aeb2-0968010b886d admin admin] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:30.995220 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd29f-28f5-473f-aeb2-0968010b886d admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:30.995487 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0cd29f-28f5-473f-aeb2-0968010b886d admin admin] PATH_INFO: `/v3/roles` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:30.996116 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cd29f-28f5-473f-aeb2-0968010b886d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:30.998411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0cd29f-28f5-473f-aeb2-0968010b886d admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:31.008061 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1438/2881] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:49:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:49:31.011838 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9cf3b-55f8-4b55-b2ea-7146a011c40c admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:31.022337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9cf3b-55f8-4b55-b2ea-7146a011c40c admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:31.027125 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb93ff0-6b4d-42fd-bfd3-6e201f8465a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:31.027705 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb93ff0-6b4d-42fd-bfd3-6e201f8465a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:31.027986 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb93ff0-6b4d-42fd-bfd3-6e201f8465a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:31.028257 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb93ff0-6b4d-42fd-bfd3-6e201f8465a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:31.028961 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb93ff0-6b4d-42fd-bfd3-6e201f8465a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:31.030712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb93ff0-6b4d-42fd-bfd3-6e201f8465a5 admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:31.041116 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1444/2882] 10.222.0.88 () {58 vars in 1122 bytes} [Fri Aug 26 00:49:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 26 00:49:31.045130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cd29f-28f5-473f-aeb2-0968010b886d admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:31.054811 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0cd29f-28f5-473f-aeb2-0968010b886d admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:31.059322 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:31.059954 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] REQUEST_METHOD: `PUT` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:31.060855 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:31.061138 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] PATH_INFO: `/v3/projects/2bc0ae91fc464804a3ce4405feb63719/users/303b1d6e3754477a9358eeb087ba0f27/roles/e104332d9de24bed8d32257cab931633` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:31.075121 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bc0ae91fc464804a3ce4405feb63719, user_id=303b1d6e3754477a9358eeb087ba0f27, role_id=e104332d9de24bed8d32257cab931633)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:31.078452 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:31.091579 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1439/2883] 10.222.0.88 () {60 vars in 1483 bytes} [Fri Aug 26 00:49:31 2022] PUT /identity/v3/projects/2bc0ae91fc464804a3ce4405feb63719/users/303b1d6e3754477a9358eeb087ba0f27/roles/e104332d9de24bed8d32257cab931633 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 26 00:49:31.096597 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1360bf-6fa0-48c3-8745-8c3d16a8685b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:31.096931 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1360bf-6fa0-48c3-8745-8c3d16a8685b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:31.097213 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1360bf-6fa0-48c3-8745-8c3d16a8685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:31.116696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-7d1360bf-6fa0-48c3-8745-8c3d16a8685b None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:31.117946 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-7d1360bf-6fa0-48c3-8745-8c3d16a8685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:31.177353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1445/2884] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:31.187641 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:31.189442 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:31.210627 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:31.246357 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7bcce-0f50-451a-8d24-e536ffddabcc admin admin] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:31.251041 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:31.251647 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:31.251939 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:31.252216 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:31.261171 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:31.262643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:31.272302 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1440/2885] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:49:31.889337 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc18fa-a740-49d4-8595-d7025ab21a1b None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:31.889739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc18fa-a740-49d4-8595-d7025ab21a1b None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:31.890078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc18fa-a740-49d4-8595-d7025ab21a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:31.919463 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-dcfc18fa-a740-49d4-8595-d7025ab21a1b None None] MFA Rules not processed for user `303b1d6e3754477a9358eeb087ba0f27`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:31.920697 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-dcfc18fa-a740-49d4-8595-d7025ab21a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:31.938470 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:31.988607 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1446/2886] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:49:31.999362 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:32.000791 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:32.059067 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930191f-58cc-4e98-aac1-07add127f7e3 service neutron] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:32.062703 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0d14a63f09046efb6d5c2533f6d3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:32.063304 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:32.063582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:32.063854 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:32.072213 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:32.073650 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:32.083177 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1441/2887] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:49:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:49:33.429472 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c0468-4502-4f77-8ff2-b037b7af102c None None] REQUEST_METHOD: `POST` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:33.430033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c0468-4502-4f77-8ff2-b037b7af102c None None] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:33.430033 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c0468-4502-4f77-8ff2-b037b7af102c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:33.449589 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.auth.core [None req-482c0468-4502-4f77-8ff2-b037b7af102c None None] MFA Rules not processed for user `303b1d6e3754477a9358eeb087ba0f27`. Rule list: `[]` (Enabled: `True`). {{(pid=81540) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:33.450894 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-482c0468-4502-4f77-8ff2-b037b7af102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:33.458026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1447/2888] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:49:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:35.914341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:35.915804 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:35.928615 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ebb98a-6b35-4125-b9f5-c21cdff42cf2 service cinder] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:35.932760 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876e8a7-e4ae-4875-ac42-faddde3e5294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:35.933412 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876e8a7-e4ae-4875-ac42-faddde3e5294 service neutron] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:35.933737 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876e8a7-e4ae-4875-ac42-faddde3e5294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:35.934064 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876e8a7-e4ae-4875-ac42-faddde3e5294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:35.936985 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-9876e8a7-e4ae-4875-ac42-faddde3e5294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:35.949698 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876e8a7-e4ae-4875-ac42-faddde3e5294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:35.951523 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9876e8a7-e4ae-4875-ac42-faddde3e5294 service neutron] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:35.960845 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1442/2889] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:49:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:49:36.628978 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c0468-4502-4f77-8ff2-b037b7af102c None None] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:36.630439 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-482c0468-4502-4f77-8ff2-b037b7af102c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:36.720031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c0468-4502-4f77-8ff2-b037b7af102c None None] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:36.725979 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:36.726593 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:36.726878 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:36.727158 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:36.728926 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:36.741712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:36.743339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:36.754807 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1448/2890] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:49:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:49:45.956515 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=49 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:46.750324 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=56 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:49:58.338837 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b612-efdd-4295-9a88-30c03369434d None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:58.339331 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b612-efdd-4295-9a88-30c03369434d None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:58.339459 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b612-efdd-4295-9a88-30c03369434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:58.359520 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-19e7b612-efdd-4295-9a88-30c03369434d None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:49:58.360729 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-19e7b612-efdd-4295-9a88-30c03369434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:49:58.368631 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1443/2891] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:49:58.394905 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:49:58.408366 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e82bc-2f30-4412-88f7-a811fb896269 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:49:58.414145 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:49:58.414739 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:49:58.415025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:49:58.415307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:49:58.423879 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:49:58.425464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:49:58.435031 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1449/2892] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:01.390831 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb515a8-1c44-4ad9-9e21-56739ea4852f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.391394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb515a8-1c44-4ad9-9e21-56739ea4852f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.391394 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb515a8-1c44-4ad9-9e21-56739ea4852f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.410374 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-dfb515a8-1c44-4ad9-9e21-56739ea4852f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:01.411567 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-dfb515a8-1c44-4ad9-9e21-56739ea4852f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:01.420134 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1444/2893] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:01.443387 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:01.444779 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:01.460071 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b34ef4e-bdb6-4045-a480-a3b7aad59ee4 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:01.465644 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7de23-6782-4f7b-9258-147ff0c4123a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:01.466291 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7de23-6782-4f7b-9258-147ff0c4123a service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:01.466590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7de23-6782-4f7b-9258-147ff0c4123a service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:01.466870 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7de23-6782-4f7b-9258-147ff0c4123a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:01.475959 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7de23-6782-4f7b-9258-147ff0c4123a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:01.477652 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7de23-6782-4f7b-9258-147ff0c4123a service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:01.489306 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1450/2894] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:04.657390 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edde9-eab3-4c5e-8430-84edf6597c15 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.657968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edde9-eab3-4c5e-8430-84edf6597c15 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.657968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68edde9-eab3-4c5e-8430-84edf6597c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.679989 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a68edde9-eab3-4c5e-8430-84edf6597c15 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:04.681182 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a68edde9-eab3-4c5e-8430-84edf6597c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:04.689048 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1445/2895] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:04.740502 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7de23-6782-4f7b-9258-147ff0c4123a service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:04.752268 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7de23-6782-4f7b-9258-147ff0c4123a service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:04.758140 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fbb08-700d-45a3-b9de-b3a26f88a447 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:04.758740 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbb08-700d-45a3-b9de-b3a26f88a447 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:04.759025 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbb08-700d-45a3-b9de-b3a26f88a447 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:04.759331 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbb08-700d-45a3-b9de-b3a26f88a447 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:04.768054 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fbb08-700d-45a3-b9de-b3a26f88a447 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:04.769624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fbb08-700d-45a3-b9de-b3a26f88a447 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:04.780640 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1451/2896] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:07.710348 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63802a2-d6b1-4647-8fbd-e04a737bceb4 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:07.710850 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63802a2-d6b1-4647-8fbd-e04a737bceb4 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:07.710959 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63802a2-d6b1-4647-8fbd-e04a737bceb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:07.730479 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-a63802a2-d6b1-4647-8fbd-e04a737bceb4 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:07.731675 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a63802a2-d6b1-4647-8fbd-e04a737bceb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:07.740293 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1446/2897] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:07.762717 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fbb08-700d-45a3-b9de-b3a26f88a447 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:07.774321 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fbb08-700d-45a3-b9de-b3a26f88a447 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:07.780972 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc31fd-978c-4a64-8cd2-ff4c5a3686bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:07.781567 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc31fd-978c-4a64-8cd2-ff4c5a3686bb service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:07.781853 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc31fd-978c-4a64-8cd2-ff4c5a3686bb service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:07.782173 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc31fd-978c-4a64-8cd2-ff4c5a3686bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:07.790414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc31fd-978c-4a64-8cd2-ff4c5a3686bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:07.791996 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc31fd-978c-4a64-8cd2-ff4c5a3686bb service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:07.802624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1452/2898] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:10.877373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8fb43-cb8c-43d1-ade9-25449c33a57f None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:10.877927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8fb43-cb8c-43d1-ade9-25449c33a57f None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:10.877927 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8fb43-cb8c-43d1-ade9-25449c33a57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:10.897677 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-14f8fb43-cb8c-43d1-ade9-25449c33a57f None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:10.898913 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-14f8fb43-cb8c-43d1-ade9-25449c33a57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:10.907690 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1447/2899] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 26 00:50:10.950078 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc31fd-978c-4a64-8cd2-ff4c5a3686bb service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:10.964987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc31fd-978c-4a64-8cd2-ff4c5a3686bb service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:10.971089 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80effc0-433a-442d-ad45-c728d893a2b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:10.971719 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80effc0-433a-442d-ad45-c728d893a2b2 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:10.971999 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80effc0-433a-442d-ad45-c728d893a2b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:10.972272 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80effc0-433a-442d-ad45-c728d893a2b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:10.980319 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80effc0-433a-442d-ad45-c728d893a2b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:10.982002 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80effc0-433a-442d-ad45-c728d893a2b2 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:10.991696 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1453/2900] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:14.037065 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b1f7-c236-434c-8b20-e65cf6d5a080 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.037580 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b1f7-c236-434c-8b20-e65cf6d5a080 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.037689 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75b1f7-c236-434c-8b20-e65cf6d5a080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.057341 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-ad75b1f7-c236-434c-8b20-e65cf6d5a080 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:14.058578 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-ad75b1f7-c236-434c-8b20-e65cf6d5a080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:14.067461 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1448/2901] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:14.094987 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80effc0-433a-442d-ad45-c728d893a2b2 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:14.106307 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80effc0-433a-442d-ad45-c728d893a2b2 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:14.112649 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b7922-9992-4d43-b325-870612f938dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:14.113246 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7922-9992-4d43-b325-870612f938dc service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:14.113528 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7922-9992-4d43-b325-870612f938dc service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:14.113804 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873b7922-9992-4d43-b325-870612f938dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:14.122259 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b7922-9992-4d43-b325-870612f938dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:14.124629 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873b7922-9992-4d43-b325-870612f938dc service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:14.134196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1454/2902] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:24.052313 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=18 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:24.129963 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=36 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:29.680950 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4753af5-2b4b-4aef-bc0f-67ff26ef1e0b None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:29.681472 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4753af5-2b4b-4aef-bc0f-67ff26ef1e0b None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:29.681582 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4753af5-2b4b-4aef-bc0f-67ff26ef1e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:29.702098 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-c4753af5-2b4b-4aef-bc0f-67ff26ef1e0b None None] MFA Rules not processed for user `303b1d6e3754477a9358eeb087ba0f27`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:29.703307 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c4753af5-2b4b-4aef-bc0f-67ff26ef1e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:29.710102 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1449/2903] 10.222.0.88 () {58 vars in 958 bytes} [Fri Aug 26 00:50:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:29.940642 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b7922-9992-4d43-b325-870612f938dc service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:29.950916 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873b7922-9992-4d43-b325-870612f938dc service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:29.954668 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a0e9262597de4799a64977e44b41e6aa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:29.955262 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:29.955549 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:29.955826 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:29.957557 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:29.967049 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:29.968474 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:29.976627 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1455/2904] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:30.293906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4753af5-2b4b-4aef-bc0f-67ff26ef1e0b None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:30.296450 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-c4753af5-2b4b-4aef-bc0f-67ff26ef1e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:30.366480 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4753af5-2b4b-4aef-bc0f-67ff26ef1e0b None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:30.371429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8a83b-f9c7-4aa4-907c-c98d79054876 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:30.372039 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a83b-f9c7-4aa4-907c-c98d79054876 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:30.372321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a83b-f9c7-4aa4-907c-c98d79054876 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:30.372668 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8a83b-f9c7-4aa4-907c-c98d79054876 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:30.374503 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-a5e8a83b-f9c7-4aa4-907c-c98d79054876 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:30.385575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8a83b-f9c7-4aa4-907c-c98d79054876 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:30.387217 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8a83b-f9c7-4aa4-907c-c98d79054876 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:30.397550 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1450/2905] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:36.745573 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:36.761399 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022fe93-a9eb-4486-8563-240423294d08 service neutron] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:36.767110 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:36.767724 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:36.768010 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:36.768287 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:36.770053 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:36.783379 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:36.784973 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:36.796509 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1456/2906] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:40.393393 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=35 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:42.459657 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e7d81-490f-4428-8a83-2ab3e91e5c57 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.460316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e7d81-490f-4428-8a83-2ab3e91e5c57 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.460316 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e7d81-490f-4428-8a83-2ab3e91e5c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.479701 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-174e7d81-490f-4428-8a83-2ab3e91e5c57 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:42.480906 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-174e7d81-490f-4428-8a83-2ab3e91e5c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:42.488649 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1451/2907] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:42.537695 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:42.548851 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953688ea-bc6e-48be-812d-9a8666282173 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:42.554339 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0b59-4490-431b-ad64-28eed7b894a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:42.554935 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0b59-4490-431b-ad64-28eed7b894a3 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:42.555212 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0b59-4490-431b-ad64-28eed7b894a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:42.555485 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0b59-4490-431b-ad64-28eed7b894a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:42.563803 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b0b59-4490-431b-ad64-28eed7b894a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:42.565367 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b0b59-4490-431b-ad64-28eed7b894a3 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:42.574849 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1457/2908] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:45.725563 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78817b-b62e-45bf-a1fc-6eb39be558aa None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:45.726130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78817b-b62e-45bf-a1fc-6eb39be558aa None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:45.726130 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78817b-b62e-45bf-a1fc-6eb39be558aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:45.745354 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-bc78817b-b62e-45bf-a1fc-6eb39be558aa None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:45.746592 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-bc78817b-b62e-45bf-a1fc-6eb39be558aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:45.755266 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1452/2909] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:45.793966 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0b59-4490-431b-ad64-28eed7b894a3 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:45.806185 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0b59-4490-431b-ad64-28eed7b894a3 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:45.811997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a976a9f-c0c3-42e4-af13-e2d84bc693dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:45.812590 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a976a9f-c0c3-42e4-af13-e2d84bc693dd service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:45.812883 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a976a9f-c0c3-42e4-af13-e2d84bc693dd service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:45.813156 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a976a9f-c0c3-42e4-af13-e2d84bc693dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:45.821302 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a976a9f-c0c3-42e4-af13-e2d84bc693dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:45.822923 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a976a9f-c0c3-42e4-af13-e2d84bc693dd service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:45.832755 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1458/2910] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:48.782411 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2b3f-8206-42fb-87c1-e0bbb24e57d3 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.782905 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2b3f-8206-42fb-87c1-e0bbb24e57d3 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.783034 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf2b3f-8206-42fb-87c1-e0bbb24e57d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.803477 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4dbf2b3f-8206-42fb-87c1-e0bbb24e57d3 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:48.804695 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4dbf2b3f-8206-42fb-87c1-e0bbb24e57d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:48.812857 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1453/2911] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:48.833445 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a976a9f-c0c3-42e4-af13-e2d84bc693dd service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:48.845768 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a976a9f-c0c3-42e4-af13-e2d84bc693dd service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:48.851383 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b51b5-0fda-4a90-925c-5cb0791173f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:48.851980 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b51b5-0fda-4a90-925c-5cb0791173f1 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:48.852267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b51b5-0fda-4a90-925c-5cb0791173f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:48.852542 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288b51b5-0fda-4a90-925c-5cb0791173f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:48.861626 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b51b5-0fda-4a90-925c-5cb0791173f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:48.863264 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288b51b5-0fda-4a90-925c-5cb0791173f1 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:48.872969 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1459/2912] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:51.962810 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6c3e1-7c07-424c-bcc2-c27737b4f136 None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:51.963389 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6c3e1-7c07-424c-bcc2-c27737b4f136 None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:51.963389 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6c3e1-7c07-424c-bcc2-c27737b4f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:51.983291 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-4ac6c3e1-7c07-424c-bcc2-c27737b4f136 None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:51.984468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-4ac6c3e1-7c07-424c-bcc2-c27737b4f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:51.992125 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1454/2913] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:52.015997 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b51b5-0fda-4a90-925c-5cb0791173f1 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:52.027487 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288b51b5-0fda-4a90-925c-5cb0791173f1 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:52.033648 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21920-f79c-4d96-8f9c-07ec33bbe609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:52.034267 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21920-f79c-4d96-8f9c-07ec33bbe609 service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:52.034556 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21920-f79c-4d96-8f9c-07ec33bbe609 service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:52.034833 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde21920-f79c-4d96-8f9c-07ec33bbe609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:52.042913 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde21920-f79c-4d96-8f9c-07ec33bbe609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:52.045129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde21920-f79c-4d96-8f9c-07ec33bbe609 service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:52.054465 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1460/2914] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:50:55.111997 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71df9-1353-470d-b491-cef77de2c7df None None] REQUEST_METHOD: `POST` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.112464 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71df9-1353-470d-b491-cef77de2c7df None None] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.112667 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b71df9-1353-470d-b491-cef77de2c7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.131982 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.auth.core [None req-46b71df9-1353-470d-b491-cef77de2c7df None None] MFA Rules not processed for user `0452b4d415d54cb5a7206cef55d400d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81539) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 26 00:50:55.133174 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-46b71df9-1353-470d-b491-cef77de2c7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:50:55.141373 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1455/2915] 10.222.0.79 () {58 vars in 1016 bytes} [Fri Aug 26 00:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 26 00:50:55.174266 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21920-f79c-4d96-8f9c-07ec33bbe609 service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:50:55.180138 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=37 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:50:55.186346 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde21920-f79c-4d96-8f9c-07ec33bbe609 service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:50:55.191867 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05c11-d1fc-4788-ab8c-ea7e1281087a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '81ac50ea01de4a9d9b76befbcba88845', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'ResellerAdmin', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:50:55.192452 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05c11-d1fc-4788-ab8c-ea7e1281087a service nova] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:50:55.192731 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05c11-d1fc-4788-ab8c-ea7e1281087a service nova] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:50:55.193004 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb05c11-d1fc-4788-ab8c-ea7e1281087a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:50:55.201561 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05c11-d1fc-4788-ab8c-ea7e1281087a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:50:55.203171 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb05c11-d1fc-4788-ab8c-ea7e1281087a service nova] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:50:55.212414 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1461/2916] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:05.126575 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=15 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:05.208263 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=5 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:23.025254 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b71df9-1353-470d-b491-cef77de2c7df None None] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:23.038232 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b71df9-1353-470d-b491-cef77de2c7df None None] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:23.043556 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:23.044162 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] REQUEST_METHOD: `GET` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:23.045050 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:23.045321 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:23.047126 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.fernet_utils [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81539) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:51:23.058828 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:23.060468 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:23.070961 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1456/2917] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:51:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 26 00:51:23.091785 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05c11-d1fc-4788-ab8c-ea7e1281087a service nova] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:23.102239 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb05c11-d1fc-4788-ab8c-ea7e1281087a service nova] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:23.109197 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:23.109869 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:23.110184 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:23.110464 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] PATH_INFO: `/v3/users/303b1d6e3754477a9358eeb087ba0f27` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:23.111622 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] RBAC: Authorizing `identity:delete_user(user_id=303b1d6e3754477a9358eeb087ba0f27)` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:23.113569 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:23.162501 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '303b1d6e3754477a9358eeb087ba0f27'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.174690 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '303b1d6e3754477a9358eeb087ba0f27'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.175353 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '303b1d6e3754477a9358eeb087ba0f27'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.182591 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '303b1d6e3754477a9358eeb087ba0f27'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.190712 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.notifications [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '303b1d6e3754477a9358eeb087ba0f27'} {{(pid=81540) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.197666 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1462/2918] 10.222.0.88 () {58 vars in 1224 bytes} [Fri Aug 26 00:51:23 2022] DELETE /identity/v3/users/303b1d6e3754477a9358eeb087ba0f27 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:51:23.375214 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] Authenticating user token {{(pid=81539) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:51:23.385968 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da6ca39-3228-4f29-a296-2f9fb62920b1 service placement] Validating token access rules against request {{(pid=81539) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:51:23.450283 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0452b4d415d54cb5a7206cef55d400d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ee2e995cfe564d738c96205c2a9aff37', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81539) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:51:23.450951 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:51:23.451238 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:51:23.451517 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] PATH_INFO: `/v3/projects/2bc0ae91fc464804a3ce4405feb63719` {{(pid=81539) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:51:23.452643 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bc0ae91fc464804a3ce4405feb63719)` {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:51:23.454693 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] RBAC: Authorization granted {{(pid=81539) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:51:23.501148 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bc0ae91fc464804a3ce4405feb63719', 'request_id': 'req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.506581 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bc0ae91fc464804a3ce4405feb63719', 'request_id': 'req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.513904 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bc0ae91fc464804a3ce4405feb63719', 'request_id': 'req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e'} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.525474 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] The token cache is being invalidate because project 2bc0ae91fc464804a3ce4405feb63719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81539) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 26 00:51:23.525764 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.526429 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG keystone.notifications [None req-01cc68a9-7b29-4fac-8be5-9ed7fd63f89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81539) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 26 00:51:23.528145 dv-cinder-835384-25-smb devstack@keystone.service[81539]: [pid: 81539|app: 0|req: 1457/2919] 10.222.0.88 () {58 vars in 1233 bytes} [Fri Aug 26 00:51:23 2022] DELETE /identity/v3/projects/2bc0ae91fc464804a3ce4405feb63719 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 26 00:51:33.193565 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:51:33.522494 dv-cinder-835384-25-smb devstack@keystone.service[81539]: DEBUG dbcounter [-] [81539] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81539) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 26 00:52:45.729585 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] Authenticating user token {{(pid=81540) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 26 00:52:45.731096 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:45.800194 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ffff2-cabd-4209-a781-41bc6ee84ecc admin admin] Validating token access rules against request {{(pid=81540) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 26 00:52:45.857504 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d7eb6-723c-40c0-b2fa-a24e7191cb39 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c06e04bd894c57a035e01e92610a98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7e3e33d0a33462699462bf537eae60c', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81540) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 26 00:52:45.858129 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7eb6-723c-40c0-b2fa-a24e7191cb39 service placement] REQUEST_METHOD: `GET` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 26 00:52:45.858408 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7eb6-723c-40c0-b2fa-a24e7191cb39 service placement] SCRIPT_NAME: `/identity` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 26 00:52:45.858678 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d7eb6-723c-40c0-b2fa-a24e7191cb39 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81540) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 26 00:52:45.860494 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.fernet_utils [None req-df0d7eb6-723c-40c0-b2fa-a24e7191cb39 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81540) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 26 00:52:45.871624 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d7eb6-723c-40c0-b2fa-a24e7191cb39 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 26 00:52:45.873196 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d7eb6-723c-40c0-b2fa-a24e7191cb39 service placement] RBAC: Authorization granted {{(pid=81540) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 26 00:52:45.883026 dv-cinder-835384-25-smb devstack@keystone.service[81540]: [pid: 81540|app: 0|req: 1463/2920] 10.222.0.88 () {60 vars in 1365 bytes} [Fri Aug 26 00:52:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 26 00:52:55.878899 dv-cinder-835384-25-smb devstack@keystone.service[81540]: DEBUG dbcounter [-] [81540] Writing DB stats keystone:SELECT=58 {{(pid=81540) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}